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Foreword 


This  collection  of  technical  reports  and  technical  memoranda  deals 
with  the  following  topics:  accurate  efficient  evaluation  of  cumulative  or 
exceedance  probability  distributions  directly  from  characteristic 
functions;  determination  of  the  performance  of  general  second-order 
processors  with  nonstationary  Gaussian  inputs;  the  exact  operating 
characteristics  of  a  sum  of  an  envelope-detected  narrowband  Gausdan 
process  and  sine  wave;  the  resolution  of  the  right-left  ambiguity  of  a 
randomly  moving  line  array;  the  operating  characteristics  of  a  cross- 
correlator  with  sample  mean  removal;  statistical  characterization  of  the 
under-ice  profile;  and  the  evaluation  of  densities  and  distributions  from 
knowledge  of  high-order  moments. 

Some  of  the  material  presented  here  is  based  heavily  on  earlier  work 
by  the  author,  which  can  be  found  in  the  following  volumes  in  addition 
to  the  referenced  technical  reports: 

Performance  of  Detection  and  Communication  Systems,  NUSC 

Scientific  and  Engineering  Studies,  1974; 

Spectral  Elstimation,  NUSC  Scientific  and  Engineering  Studies,  1977; 

Coherence  Estimation,  NUSC  Scientific  and  Engineering  Studies, 

1979; 

Receiver  Performance  Evaluation  and  Spectral  Analysis,  NUSC 

Scientific  and  Engineering  Studies,  1981;  and 

Signal  Processing  Studies,  NUSC  Scientific  and  Engineering  Studies, 

1983. 
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Accurate  Efficient  Evaluation 
Of  Cumulative  or  Exceedance 
Probability  Distributions 
Directly  From 
Characteristic  Functions 


A.  H.  Nuttall 

ABSTRACT 

An  accurate  and  efficient  method  of  evaluating  the  entire  cumulative 
or  exceedance  probability  distribution,  via  one  fast  Fourier  transform 
of  the  sampled  characteristic  function,  is  presented.  The  sampling  rate 
applied  to  the  characteristic  function  results  in  aliasing  of  the 
probability  density  function,  while  the  limited  extent  of  the  sampling 
gives  rise  to  a  systematic  disturbance  in  the  calculated  probability 
distribution.  Both  types  of  errors  are  easily  recognizable  and  can  be 
controlled  by  a  trial  and  error  procedure  whereby  the  calculated 
distributions  are  plotted  for  observation  and  modification. 

The  size  of  the  fast  Fourier  transform  determines  the  number  of 
distribution  values  available,  but  hais  no  effect  on  the  accuracy  of  the 
result.  Regardless  of  the  number  of  characteristic  function  evaluations 
required  for  accurate  results,  the  storage  required  is  just  that 
corresponding  to  the  size  of  the  fast  Fourier  transform. 

A  program  for  the  procedure  is  presented  and  the  inputs  required  of 
the  user  are  indicated.  Several  representative  examples  and  plots 
illustrate  the  utility  of  the  approach. 


Approved  for  public  release;  distribution  unlimited. 
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ACCURATE  EFFICIENT  EVALUATION  OF  CUMULATIVE  OR 
EXCEEDANCE  PROBABILITY  DISTRIBUTIONS  DIRECTLY  FROM 
CHARACTERISTIC  FUNCTIONS 

INTRODUCTION 

The  performance  of  a  signal  processor  can  often  be  evaluated  in  terms  of 
the  characteristic  function  of  the  decision  variable,  either  numerically  or  in 
closed  form;  see  for  example,  refs.  1  and  2.  However,  a  closed  form  for  the 
corresponding  probability  density  function  or  cumulative  distribution  function 
is  seldom  available,  and  numerical  procedures  must  be  employed.  Several  such 
procedures  have  been  published  in  the  literature,  refs.  3-8.  However  they 
have  limited  accuracy  or  they  require  extensive  storage  or  analytical 
manipulations  and  calculations. 

We  present  a  technique  which  is  limited  in  accuracy  only  by  the  round-off 
noise  of  the  computer  or  by  the  errors' of  the  special  functions  required  in 
the  characteristic  function  calculation.  The  amount  of  storage  depends  only 
on  the  number  of  cumulative  or  exceedance  distribution  function  values 
requested  and  does  not  influence  the  accuracy  of  the  final  probability 
values.  The  entire  cumulative  and  exceedance  distribution  function  values 
result  as  the  output  of  one  fast  Fourier  transform  (FFT).  The  size  of  the  FFT 
dictates  the  storage  required  and  the  spacing  of  the  calculated  probability 
values,  but  not  their  accuracy. 

The  addition  and  subtraction  of  integrand  functions  given  in  ref.  7  can 
be  entirely  circumvented  and  yet  enable  use  of  an  FFT,  through  proper 
manipulation  of  the  origin  contribution  of  the  characteristic  function. 
Specific  connections  with  past  results  will  be  noted  at  appropriate  points  in 
the  derivations. 
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DERIVATION  OF  PROCEDURE 


Shifted  Random  Variable 


The  primary  random  variable  of  interest  is  the  real  quantity  x  with  given 
characteristic  function  fj^(f)  which  is  related  to  the  probability  density 
function  p^  of  random  variable  x  via  Fourier  transform  * 

fj^(5)  “J'dv  exp(ijv)  P^(v).  (1) 

We  define  secondary  random  variable  y  as 

y  =  x+b,  (2) 

where  bias  (shift)  b  is  a  constant,  chosen  such  that  random  variable  y  has 
insignificant  probability  of  being  less  than  zero.  However,  we  also  pick  b  as 
small  as  possible,  so  that  the  characteristic  function  of  y, 

fy(!r)  =  fx(?)  exp(ibl),  (3) 

will  vary  slowly  withj.  In  fact,  b  can  be  negative,  as  for  example  if  x  were 
limited  to  values  larger  than  some  positive  threshold.  The  approach  here  is 
not  limited  to  positive  random  variables  x,  as  were  some  of  the  results  in 
ref.  7,  but  is  applicable  to  any  random  variable  distribution. 

By  way  of  example,  for  an  exponential  probability  density  function  for 
random  variable  x,  we  choose  b-O;  while  for  a  Gaussian  random  variable, 
be'»j^+8aj^  yields  a  probability  !ess  than  lE-15  of  y  being  negative.  The 
probability  density  function  of  random  variable  y  therefore  appears  as 
depicted  in  figure  1. 


*  Integrals  and  sums  without  limits  are  over 
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Figure  1.  Probability  Density  Function  of  Secondary  Random  Variable  y 

The  cumulative  distribution  functions  of  random  variables  y  and  x  are 
related  according  to 

V 

Jdt  Py(t)  =  P^(v)  =  P^{v-b);  P^(v)  =  Py(v+b).  (4) 

Thus  we  can  inspect  Pj^(v)  in  the  neighborhood  of  v=-b  (the  lower  edge  of 
interest  of  x)  by  looking  at  cumulative  distribution  function  Py{v)  in  the 
neighborhood  of  vaO.  More  precisely,  we  will  investigate  Py(v)  for  values 
of  V  greater  than  zero,  since  this  is  the  region  of  significant  variation  of 
Py(v);  this  is  called  the  positive  neighborhood  of  v»0. 

V 

Approximation  to  Cumulative  Distribution  Function 


From  ref.  4,  eq.  7,  we  have  the  cumulative  distribution  function  of 
random  variable  y  in  terms  of  the  characteristic  function  according  to 


Pv(v)  -  j  -fdf  g(f,v). 


(5) 


Of 


where  we  have  defined  auxiliary  function 


g(t,v)  »  Im  -j  exp{-i5v) 


jexp{-1Jy) 


(6) 


Observe  for  later  use  that 


g{0+,v) 


«  lim  Im<(l~ifv) 

I 


Ww-v 


(7) 


where  Uy  is  the  mean  of  random  variable  y. 
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For  V  in  the  neighborhood  of  zero,  exp(-i|v)  in  (6)  varies  slowly  with  JF, 
and  we  have  the  approximation,  via  the  Trapezoidal  rule,  to  (5)  as 

+«e> 

Py(v)  -  J  g(0'^>v)  -  2  A  g(n&,v)  e  C(v),  (8) 

n=l 

where  the  right-hand  side  of  (8)  has  been  defined  as  C(v).  Here,  a  is  the 
sampling  interval  in  5,  and  is  small  enough  to  track  changes  in  exp(-i?v)* 
fy(5)/|.  We  choose  the  Trapezoidal  rule  in  (8)  over  other  integration  rules, 
such  as  Simpson's  rule,  because  it  results  in  minimum  aliasing  for  Fourier 
transforms  relative  to  all  other  rules;  see  appendix  A  for  elaboration  and 
proof. 

Observe  from  (8)  that 

Py(0)  a  C(0)  means  C(0)  a  0,  (9) 

since  Py(0)  is  insignificant  by  the  choice  of  b  in  (2);  this  relation  will 
be  used  later. 


Relationship  of  Approximation 


Although  we  want  to  evaluate  the  exact  cumulative  distribution  function 
Py(v),  we  have  instead  arrived  at  an  approximation  C{v)  via  (8).  How  are 
these  two  related?  To  determine  the  relationship,  we  manipu’^te  (6)-{8)  as 
follows: 


C{v) 


n=l 


Im  ■|exp{-inAv) 


wn 


1 

1. 


expfiriAv) 


n  * 


(10) 


(11) 
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The  renioval  of  the  imaginary  operation  from  within  the  summation  in  (10)  is  a 
crucial  step;  it  does  not  create  a  problem  in  divergence  since  n  >  0.  This  is 
in  contrast  with  the  integral  of  (5)  and  (6),  where  removal  of  the  imaginary 
operation  would  create  a  divergent  integral.  This  postponement  of  the  removal 
of  the  imaginary  operation,  until  after  the  approximation  to  the  integral  was 
developed  in  (8),  is  the  major  difference  with  the  results  in  ref.  7. 

Taking  a  derivative  of  (11),  we  obtain 

*  It  *  Iv  f^{nA)  = 

n^tO 

“  h  1  exp(-inAv}  fy(na) = 
n 

■It  r?  V?)  = 

■  =  ^Py(v-"  f)s  Py(v).  (12) 

A  n 

where  infinite  impulse  train 

(13) 

n 

where®  denotes  convolution,  and  where  we  have  used  the  relation 

Jdt  exp(-iwt)  aS^{t)  (14) 

This  last  result  follows  from  ref.  9,  p.  28,  rule  11,  with  u(t)  =  S(t),  T=a, 
Fal/T,  and  w«2irf.  Relation  (12)  indicates  that  C'(v)  is  an  infinitely  aliased 
version  of  the  probability  density  function  Py{v),  with  resultant  period 
2it/a  in  V.  For  small  enough  sampling  increment  a  in  (8),  there  will  be  very 
little  overlap  of  the  displaced  versions  of  p^  in  (12),  thereby  yielding  the 
good  approximation 
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Py(v)  «  Py{v)  for  0  <  V  <  2it/i.  (15) 

The  situation  for  relation  (12)  is  depicted  in  figure  2. 


There  now  follows  from  (12), 


C(v)  «  C(0)  + 


du  tiy(u)  3E  C(0)  Py(v), 


(16) 


where  C(0)  is  given  by  (10)  as 


(17) 


Relation  (16)  is  an  exact  relation,  showing  that  C(v)  is  the  integral  of  the 
infinitely  aliased  version  of  Py(v),  starting  at  v»0,  plus  an  additive 
constant  which  is  substantially  zero;  see  (9), 


So  for  V  in  the  positive  neighborhood  of  zero,  (4),  (8),  (16),  and  (9) 

yield 


P^(v-b)  .  Py(v)  ■  C(v)  -  C(0)  +  yv)  *  y  V).  (18) 

Thus  the  quantity  we  want,  the  left-most  term  in  (18),  is 
well-approximated  by  calculated  quantity  C(v),  which  itself  is  approximately 
the  integral  of  the  infinitely  aliased  version  of  Py(v). 

•J 
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Calculation  of  C(vj 


2irk  . 


Let  V  *  in  (10),  where  M  and  k  are  arbitrary  integers.  Then 


1  k  JV 

“  ^  M  “  ~  exp(-i2nnk/M)-^Ll_ —  ,  - 


1 

“  I  I  ~  n  ^  exp(-i2irnk/M)  z^L 

tn=0  J 


Where  we  define  complex  sequence 


i  Tor  n=0 


jf^(na)/n  for  n>lj 


Now  define  collapsed  sequence  (ref.  7,  pp.  13-16)  as 


?  -  > 
n  ^ 

j=0 


Vmj  0<n<M-l. 


Then  since  receives  the  same  weight  as  Zp+f^j  in  (19),  regardless  of  the 
value  of  k,  (19)  can  be  expressed  as 


1  +  k 

7  M 


-  7  exp(-i2Trnk/M) 


Relation  (22)  is  exact  and  valid  for  all  k.  Since  we  are  only  interested 
in  the  positive  neighbornood  of  v=0  in  (18),  we  confine  attention  in  (22)  to 
0  £  k  £  M-1.*  Relation  (22)  can  then  be  accomplished  by  an  M-point  FFT  if  M 
is  chosen  to  be  a  power  of  2.  Notice  that  storage  only  for  the  M  complex 

numbers  {^2 jn  (21)  is  required,  even  though  the  {z^,^  sequence  in  (20)  is 
of  infinite  length. 


*  Values  for  other  k  are  available  from  (22)  when  we  observe  that 

1  (If) 
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Observe  that  the  size  of  M  in  no  way  affects  the  error  of  the  calculation  of 

C{^^)  or  estimation  of  Py{v}.  Rather,  M  specifies  the  spacing  at  which  C(^^)  is 

calculated,  and  can  be  coarse  if  desired.  The  accuracy  of  the  estimate  of 
Py(v)  is  governed  thus  far  by  a,  through  the  aliasing  depicted  in  figure  2. 

Reference  to  (18)  now  yields 


0<k<M-l,  (23) 

where  the  latter  quantity  is  given  by  (22).  Thus  the  M-point  FFT  sweeps  out 
the  argument  range  (-b,-b+2ir/A)  for  the  cumulative  distribution  function 

If  we  want  the  exceedance  distribution  function  of  y  instead  of  the 
cumulative  distribution  function,  we  use  (18)  and  (22)  to  get 


1  -  C(^) 


1  k  .  1 

2  ■  M  ir 


Imj^  exp(-i2irnk/M) 
{n=0 


V  for  0  <  k  <  M-1, 


(24) 


(By  the  footnote  to  (22),  we  have  l-C(2ir/a)  =*  -C(0).) 


Since  must  be  known  in  (20)  in  order  to  use  this  approach,  we  need 
the  mean  of  random  variable  x,  since  from  (2) 

Wy  =  Uj^+b.  (25) 

The  quantity  can  be  found  analytically  from  characteristic  function 
fj((]F)  according  to 


f^{0)  =  iu^;  (26) 


see  (1). 
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In  addition  to  the  error  caused  by  aliasing  associated  with  nonzero 
sampling  increment  a,  an  additional  error  occurs  because  we  cannot  calculate 
all  the  coefficients  in  (20)  and  (21)  out  to  n=+*.  Rather,  we 
terminate  the  calculation  at  integer  n=N,  such  that  jz^j  is  sufficiently 
small  as  to  be  negligible  for  n  2  N.  Letting 

L  =  Na,  {27} 

this  is  equivalent  to  ignoring  the  contribution  to  (5)  of  the  tail  error 

r  f 

-  g(?,v}  =  -Im  J  df  exp(-ijv)  .  (28) 

L  L 

If  the  as^ptotic  behavior  of  ^y(J)  for  large  J  is  known,  this  error  can 
sometimes  be  evaluated  in  closed  form  and  used  to  ascertain  an  adequate  value 
of  L.  Instead,  we  have  observed  that  tail  error  (28)  causes  a  characteristic 
low-level  sinusoidal  variation  in  the  calculated  cumulative  distribution 
function  for  small  v  near  0,  and  in  the  calculated  exceedance  distribution 
function  for  large  v  near  2w/&.  When  this  sinusoidal  variation  is  deemed 
excessive,  L  can  be  increased  until  the  effect  disappears  or  decreases  to 
acceptable  levels.  This  trial  and  error  approach  avoids  the  necessity  of 
analytically  upper-bounding  the  magnitude  of  error  (28),  which  is  often  very 
tedious  and  generally  pessimistic. 

So  there  are  two  errors  to  be  concerned  with:  aliasing  due  to  nonzero 
sampling  interval  &  and  tail  error  due  to  non  infinite  limit  L.  Later 
examples  will  demonstrate  how  these  errors  manifest  themselves  in  the 
cumulative  and  exceedance  distribution  functions  and  how  they  can  be 
controlled  by  a  trial  and  error  app”oach. 
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Relation  to  Requicha's  Method^  ref.  5 


From  ref.  5,  eqs.  7,  9,  10,  the  cumulative  distribution  function  is  given 
by  an  expression  that  can  be  manipulated  into  the  form  (using  current  notation) 


%2 


F,.  = 


k  ^  T  mJ 

I  -  7  ‘"i 


^  exp(-i2nkn/M)  ^ 
n=l 


(29) 


Although  this  is  similar  to  the  upper  line  of  (19)  here,  it  differs  in  several 
important  respects: 


1.  Fj^  does  not  use  mean  at  all;  it  is  therefore  not  using  a 
direct  approximation  to  the  specified  integral  in  (5)  and  (6). 

2.  From  (29),  there  follows  Fq  =  0,  Fj^j  =  1;  however,  these  results 

are  not  strictly  true  for  the  actual  cumulative  distribution  function  at  these 
end  points,  thereby  leading  to  poor  estimates  in  the  neighborhoods  of  these 
points.  This  is  due  to  the  arbitrary  origin  established  in  ref.  5,  eg.  6. 

3.  The  sums  in  (29)  utilize  characteristic  function  samples  fy(na) 
only  for  n  <  M/2,  where  M  is  the  size  of  the  FFT.  This  is  a  very  severe  and 
unnecessary  restriction;  in  fact,  the  sum  on  n  in  (29)  ought  to  be  conducted 
to  the  point  where  the  tail  contribution,  (28),  is  negligible,  regardless  of 
the  value  of  M. 


4,  In  ref.  5,  if  eg.  4  is  substituted  into  eq.  1,  and  the  summation 
limits  are  extended  to  too,  we  gee  exactly  the  second  line  of  (12)  here.  When 
the  probability  density  function  is  integrated  to  get  the  cumulative 
distribution  function  in  ref.  5,  eq.  6,  the  resultant  cumulative  distribution 
function  is  arbitrarily  set  to  zero  at  v=0.  We  instead  have  from  (9)  and  (17), 


which  is  small,  but  not  necessarily  zero.  This  consideration  is  very 

important  on  the  tails  of  the  cumulative  and  exceedance  distribution  functions. 
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Summary  of  Procedure 

The  cumulative  distribution  function  of  y  is  given  by 

(M-1 

®  “  I  '  7  I  ^  exp{-i2irnk/M) 

I  n«0 


for  0  <  k  <  M-1, 


(31) 


where  M  is  the  size  of  the  FFT  and  storage  employed.  Also 


j>0 

where 


(32) 


^n  * 


n?‘“j 

\  f.;(n/ 


for  n=0 


1 


(na) /n  for  1  <.  n  £  N 


for  n  >  N 


J 


(33) 


(The  value  for  n^N  should  be  scaled  by  1/2  for  the  Trapezoidal  rule). 

The  zero  values  for  z^,  when  n  >  N,  serve  to  terminate  the  collapsed  sum  in 
(32)  at  a  finite  upper  limit.  The  value  of  N  is  given  by  the  integer  part  of 
L/a,  where  a  and  L  must  be  chosen  so  as  to  minimize  aliasing  and  tail  error, 
respectively.  The  characteristic  function  of  random  variable  y  needed  in  (33) 
is  given  by 


^y(T)  “  exp(ibF),  (34) 

in  terms  of  the  characteristic  function  of  the  primary  random  variable  x, 
where  shift  b  must  be  chosen  such  that  y  »  b+x  is  positive  with  probabilty 
virtually  1.  The  mean  a  b+^x  can  be  determined  analytically  from 
knowledge  of  characteristic  function  fj^(5).  Finally,  the  exceedance 
distribution  function  for  random  variable  y  is  obtained  by  subtracting  (31) 
from  1. 
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EXAMPLES 

Programs  for  the  following  five  examples  are  listed  in  appendix  B. 

1.  Chi-Square 

A  chi-square  variate  of  2K  degrees  of  freedom  has  probability  density 
function  (ref.  10) 


p  (V)  =  for  V  >  0  (35) 

and  characteristic  function 

f^(f)  -  (36) 

Since  random  variable  x  is  obviously  nonnegative  by  (35),  we  can  choose  shift 
b=0;  i.e.  y=x.  A  plot  of  the  cumulative  and  exceedance  distribution  functions 
of  random  variable  y  obtained  from  characteristic  function  (36)  with  Ks4  is 
given  in  figure  3  for  0  £  v  £  ZrdL.  The  values  of  a  and  L  have  been  chosen 
such  that  aliasing  and  tail  error  are  insignificant. 

The  ordinate  scale  for  figure  3  is  a  logarithmic  one.  The  lower  right 
end  of  the  exceedance  distribution  function  curve  decreases  smoothly  to  the 
region  lE-11,  where  round-off  noise  is  encountered.  The  exceedance 
distribution  function  values  continue  to  decrease  with  v  until,  finally, 
negative  values  (due  to  round-off  noise)  are  generated.  For  negative 
probability  values,  the  logarithm  of  the  absolute  value  is  plotted,  but 
mirrored  below  the  lE-12  level.  These  values  have  no  physical  significance, 
of  course;  they  are  plotted  to  illustrate  the  level  of  accuracy  attainable  by 
this  procedure  with  appropriate  choices  of  &  and  L. 

For  this  example,  N=L/a=2666,  while  Ma256.  Thus  collapsing,  according  to 
(21)  or  (32),  by  over  a  factor  of  10  has  been  employed  and  a  small  size  FFT 
has  been  utilized.  Nevertheless  the  error  realized  for  the  cumulative  and 
exceedance  distribution  functions  is  in  the  lE-12  range,  the  limit  of  accuracy 
of  the  Hewlett  Packard  9845B  Desk  Calculator  used  here.  Finer  spacing  in  the 
distribution  outputs  is  achievable  by  merely  increasing  M. 
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2.  Gaussian 


The  characteristic  function  for  a  zero-mean  unit-variance  random  variable 
is 


fjf)  >  exp(-j2/2).  (37) 

and  the  probability  density  function  and  cumulative  distribution  function  are 
(ref.  11,  eq.  10.5.3) 


Px(v)  .  (2.)'^'^  exp(V/2),  P^(»)  .f(v).  (38) 

For  b  =  5ii/2,  using  (4), 

Py(0)  =  Pj^(-b)  =|(-b)  =  2E-15.  (39) 


which  is  negligible,  as  desired. 

Plots  of  the  cumulative  and  exceedance  distribution  functions  for  random 
variable  y  are  given  in  figure  4  for  1*7,  A=.3.  The  logarithmic  ordinate 
gives  rise  to  the  characteristic  parabolic  shape  on  the  tails  of  the 
distributions.  Once  again,  the  probabilities  decrease  to  the  level  of  the 
round-off  noise  and  fluctuate  around  lE-12  near  the  edges  of  the  fundamental 
aliased  interval  (0,2ir/&).  The  fact  that  the  cumulative  distribution  function 
of  y  starts  in  the  round-off  noise  at  v*0  indicates  that  b=5tr/2  was  large 
enough  to  guarantee  y  >  0  with  probability  virtually  1.  Also  indicated  on  the 
figure  is  the  origin  for  random  variable  x.  We  have,  from  (4), 

Px(u)  =  Py(u+b);  (40) 


thus  for  example 


Prob(x  <  0)  =  Pj^(01  «  Py(b)  =  .5. 


(41) 
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In  figure  5,  the  only  change  is  to  decrease  limit  L  from  7  to  6.  The 
tail  error  mentioned  in  (28)  et  seq.  then  dominates  the  round-off  noise  and 
has  a  sinusoidal  variation.  Aliasing  is  not  a  problem,  as  witnessed  by  the 
fact  that  the  cumulative  and  exceedance  distribution  functions  of  random 
variable  y  have  decayed  below  lE-12  well  before  the  edges  of  the  interval  are 
reached . 

When  limit  L  is  restored  to  7,  and  sampling  increment  &  is  increased  to 
.5,  aliasing  becomes  significant,  as  shown  in  figure  6.  The  exceedance 
distribution  function  has  not  yet  decayed  to  the  round-off  noise  level  at 
v=2ir/A,  and  the  cumulative  distribution  function  shows  a  large  negative 
probability  region  near  v=0.  Shift  b  has  been  maintained  at  the  value  5ir/2, 
corresponding  to  (39). 

When  L  and  a  are  restored  to  their  values  7  and  .3  as  for  figure  4,  but  b 
is  decreased  to  5it/3,  the  probability  of  y  becoming  negative  is,  from  (4)  and 
(38),  $(-5jr/3)  *  .82E-7.  This  is  reflected  in  the  cumulative  distribution 
function  for  y  in  figure  7  at  v=:0,  where  the  probability  value  is  well  above 
the  round-off  noise  level.  Also,  the  exceedance  distribution  function 
develops  significantly  negative  values  near  v  =  2ir/A. 

Accurate  evaluation  of  the  cumulative  and  exceedance  distribution 
functions  can  only  be  achieved  when  L,  a,  and  b  are  properly  chosen.  Probably 
the  optimum  combination  for  the  Gaussian  variate  is  displayed  in  figure  8, 
where  a  has  been  increased  to  .4,  the  distributions  are  centered  on  the 
fundamental  aliased  interval  (0,  2ir/A)  by  choice  of  b,  and  L  is  taken  at  7  to 
avoid  tail  error. 

3.  Smirnov 


The  limiting  characteristic  function  of  a  measure  of  goodness  of  fit 
based  on  the  sample  distribution  function  was  derived  by  Smirnov  and  is  given 
by  (ref.  12,  eq.  30.104) 
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Figure  5.  Gaussian;  L^B,  A“,3,  b“2.5ir,  M-256 


1 


LOG10  PROBABILITY 


TR  No.  7023 


18 


LOG 10  PROBABILITY 


TR  No.  7023 


19 


TR  No.  7023 


An  expansion  about  |=0  yields 

f^(^)  =  1+1  1*e*»  v»j(  *  1/6,  0^  *  1/45.  (43) 

And  since  the  goodness  of  fit  Is  always  positive,  random  variable  x  is 
positive  and  we  can  choose 

b-0.  (44) 


Since 


sin((l+i ij  exp(^(l-i))  as  (4}) 

it  follows  that 

f^Cf)  -  exp(-  |Vf  -g))  as  ?-++*.  (46) 

The  phase  of  this  term  rotates  according  to  i/f/2;  if  we  were  to  choose  b^O, 
'fy(5)  would  rotate  faster  than  fx(^)  (linear  with  rather  thani/f').  This 
could  necessitate  a  faster  sampling  rate,  which  is  undesirable. 

The  cumulative  and  exceedance  distribution  functions  are  plotted  in 
figure  9.  L  and  a  have  been  chosen  so  as  to  avoid  tail  error  and  aliasing. 

The  exceedance  distribution  function  is  seen  to  decay  exponentially  until  it 
reaches  approximately  2E-11;  the  bump  in  the  curve  at  this  point  is  a 
manifestation  of  the  limited  accuracy  of  the  trigonometric  functions  built 
into  the  calculator  employed.  Larger  values  of  v  lead  to  round-off  noise 
around  the  lE-12  level. 

A  comparison  of  results  for  this  characteristic  function,  with  Requicha's 
method  described  in  (29)  et  seq.,  is  given  in  figure  10  for  FFT  size  Mal024. 
The  plot  labeled  with  N«La512  is  precisely  Requicha's  method.  Aliasing  is 
known  to  be  insignificant  for  a»1,  as  seen  by  reference  to  figure  9  and 
observing  that  extrapolation  of  the  straight  line  section  of  the  exceedance 
distribution  function  would  result  in  probability  values  near  lE-13  at 
v«2it/&.  The  dashed  portion  of  the  NaLa512  curve  in  figure  10  in  fact 
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Figure  10.  Comperleon  with  Requichi's  Method; 
4*1,  b*0,  M-1024 


TR  No.  7023 

corresponds  to  negative  probability  estimates;  these  grossly  inaccurate 
results  are  due  to  an  inadequate  value  of  limit  L,  leading  to  large  tail  error. 

When  N  is  simply  increased  to  1023,  the  middle  curve  in  figure  10  results 
from  Requicha’s  method.  Again,  negative  estimates  are  indicated  by  the  dashed 
portion  of  this  curve,  although  two  orders  of  magnitude  smaller  than  above. 

The  reasons  for  these  errors  have  been  delineated  in  (29)  et  seq. 

The  bottom-most  curve  in  figure  10  (solid  curve)  is  that  obtained  by  the 
method  proposed  in  this  report  for  L  »  1023.  Exceedance  distribution  function 
estimates  in  the  lE-10  range  are  obtained,  but  the  error  returns  to  the  lE-8 
range  at  v=2ii/4.  No  negative  probability  values  occur.  Also,  by  simply 
increasing  limit  L,  while  keeping  EFT  size  M  fixed,  the  error  can  be  reduced 
significantly  further,  as  already  witnessed  by  figure  9. 

4.  Noncentral  Chi-Square 


Here  the  random  variable  x  is  given  by 

X  -  2  (9k  *  («) 

k»l 

where  {d|^^  are  constants,  and  {gj^}  are  independent  Gaussian  random 

variables  with  zero-mean  and  unit  variance.  The  characteristic  function  of  x 

is 


f,(5)  -  »  ('*®> 

where  deflection  d  is  defined  according  to 

d^  «  ^  d^.  (49) 

k«l 


We  actually  consider  a  more  general  characteristic  function  than  (48),  namely 
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f^dF)  =  (1-12?)"''  exp|j3^j  =  exp(p^  -  s>Ml-i2f)J,  (50) 

where  v  is  an  arbitrary  positive  real  constant.  Suppose  that  we  use  the 
principal  value  logarithm  for  J?n(z),  where  the  branch  cut  lies  along  the 
negative  real  axis  of  the  complex  z  plane  (ref.  13,  sect.  4.1.1).  Then  since 
the  argument  of  the  logarithm  in  (50)  never  crosses  the  branch  cut,  form  (50) 
gives  the  correct  characteristic  function  values  automatically  for  all  real?, 
and  any  v. 


The  probability  density  function  and  exceedance  distribution  function 
corresponding  to  (50)  are  (ref.  14,  6.631  4) 


P,(v) 


=  lexp(-4i)(f)'’''l^l(dV7)  for 


V  >  0, 


•HO 


(dt)  s  Q^(d,Y^  for  v  >  0.  (51) 


Since  the  probability  density  function  in  (51)  is  never  negative  (ref.  13, 
sect.  9.6.1),  (50)  is  a  legal  characteristic  function.  Also  because  random 
variable  x  is  always  positive  according  to  (51),  we  choose  shift  b=0.  Plots 
of  the  exceedance  distribution  function,  as  determined  from  characteristic 
function  (50)  are  displayed  for  various  values  of  d  in  figure  11.  The  values 
of  L  were  chosen  for  each  d  value  so  as  to  control  the  tail  error  below  the 
lE-10  level  plotted.  Direct  calculation  of  the  exceedance  distribution 
function  directly  from  (51)  would  be  a  formidable  task  for  arbitrary  v  values, 

5.  Product  of  Correlated  Gaussian  Variates 


X  =  St 


where  s  and  t  are  zero-mean  unit-variance  Gaussian  random  variables  with 
correlation  coefficient  p.  The  joint  probability  density  function  of  s  and  t 
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PstC'^.*) 


exp 


2  2 

u  -^v  -2puv 


2(1-7) 


The  characteristic  function  of  x  is  then 


(53) 


fj^(f)  =  exp(ifst)  » JJdu  dv  expjifuv)  P^^Cu.v)  - 
jl-i2p5+(l-P^)f  -  [l-i(l+p)^’^^^  [l+i(l-p)fj“^^^. 


(54) 


via  repeated  use  of  ref.  14,  eq.  3.323  2.  The  corresponding  probability 
density  function  of  x  is 


P,(v) 


Pst(y.7) 


for  all  V, 


(55) 


via  ref.  14,  eq.  3.478  4. 


(If  we  transform  this  probability  density  function  according  to  (1)  and 
use  ref.  14,  eq.  6.611  9  and  ref.  13,  eq.  4.4.15,  we  get  precisely  (54). 
Alternatively,  if  we  transform  (54)  and  modify  the  contour  to  wrap  around  the 
branch  line  along  the  imaginary  axis  and  then  use  ref.  14,  eq.  3.388  2,  we  get 
(55).  Or  we  can  use  ref.  14,  eq.  3.754  2.) 

We  actually  consider  a  more  general  characteristic  function  than  (54), 
namely 


=  [l-i2pr(l-p^)5^J  ''  =  exp^v^[l-i2pT+  (l-P^)?^Jj. 


(56) 


The  mean  of  this  random  variable  x  is  given  by 


■  2vp. 


(57) 
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The  probability  density  function  corresponding  to  (56)  is 


“  h  exp(-i?v)  f^df)  * 


We  can  move  the  contour  in  (58)  to  the  real  y-axis,  because  the  branch  points 
of  the  integrand  are  at  y  =  ±  which  are  outside  the  path  of 

integration,  since  jp|  <  1.  Then  using  ref.  14,  eq.  3.771  2  and  ref.  13, 
eq.  6.1.17,  we  obtain 


P,(v) 


for  all  V.  (60) 


Since  this  probability  density  function  is  never  negative  (ref.  13,  sect. 
9.6.1),  (56)  is  a  legal  characteristic  function.  If  we  Fourier  transform  (60) 
via  ref.  14,  6.699  12.  we  get  (56)  directly. 


There  is  no  simple  relation  for  the  cumulative  distribution  function  of 
this  random  variable.  Nevertheless,  it  is  a  simple  matter  to  evaluate 
directly  from  characteristic  function  (56).  The  Jin  in  (56)  causes  no  problems 
since  its  argument  never  crosses  the  branch  cut.  A  plot  for  v=7.7  and  p=:-.3 
is  displayed  in  figure  12.  The  rate  of  decay  of  the  distribution  is  different 
for  each  tail.  The  round-off  noise  is  clearly  visible  at  both  ends  of  the 
range  of  v  values. 
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Figure  12.  Gaussian  Product;  L»5,  A“.06,  b“5Cir/3,  M*25G 
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APPLICATIONS 


We  now  have  the  capability  to  handle  the  following  type  of  statistical 
problem  in  a  fairly  easy  fashion.  Consider  random  variable 


X 


(61) 


where  ^r^^^  are  arbitrary  random  variables*  statistically  independent  of  each 
other,  and  with  different  distributions.  Power  is  arbitrary  (except  that 
V(^  must  be  a  positive  integer  for  those  r|^  that  can  become  negative).  Let 
the  probability  density  function  of  random  variable  rj^  be  P)j(v).  Then  the 


characteristic  function  of  r.  is 


g,j(?)  «  exp^ifv  ^  p,^(v)  * 


(62) 


If  (62)  is  not  integrable  in  closed  form,  it  can  be  evaluated  by  means  of  an 
FFT  (one  for  each  k  if  the  probability  density  functions  or  V|^  are  all 
different).  Then  the  characteristic  function  of  random  variable  x  in  (61)  is 
given  by 


K 

■  TK<y)]  •  (63) 

k«l 

Now  the  techniques  of  this  report  are  directly  applicable  to  (63). 

An  additional  example  is  afforded  by 
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K  2  A  ^ 

^kM  ^^^k"k*  (S4) 

k=l  Vk.l  /  k»l 

where  {a^},  and  [y^]  are  constants,  and  [vj^^  are  independent 

random  variables  with  arbitrary  probability  density  functions.  The 
characteristic  function  of  x  is 


f,(J)  = 

exp(iTx)  =  JdV  Py(V) 

exp^i|C5a 

where  V  =  (v 

'l>  V2,  ...»  Vj^).  Now 

since 

(^)  exp(-iay^  + 

we  identify 

a  =  f/4,  b  =f2B,^V|^, 

eliminate 

and  express 

(65)  as 

f,(?)  =  JdV  p, 

^(V)  exp(i 

(65) 


¥) 


for  a  0,  (66) 


*  (^)  '  ^  [(“''k  ''k<''k>  ®>‘p<'r(»k''k  *  Vk  ^ 


where 


V''>  =T{'>k'''k)]  • 

k=l 


(68) 


The  inner  integrals  in  (67)  can  either  be  done  analytically  or  numerically. 
Then  the  remaining  single  integral  on  y  must  be  numerically  evaluated  to  find 
characteristic  function  fj^(f).  As  an  example,  if  V|^  is  exponentially 
distributed 
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Pk(v)  =  aj^  exp(-a|^v)  for  v  >  0,  (69) 

then  the  inner  integrals  in  (67)  are  w-functions;  see  ref.  13,  ch.  7.  A 
simpler  method  of  handling  general  quadratic  expressions  like  (64)  with 
Gaussian  V  is  presented  in  ref.  15. 
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SUMMARY 

An  accurate  method  for  efficient  evaluation  of  the  cumulative  and 
exceedance  distribution  functions  has  been  derived  and  applied  to  several 
examples  to  illustrate  its  utility.  Choice  of  the  sampling  increment  a 
applied  to  the  characteristic  function  controls  the  aliasing  problem,  and 
selection  of  the  limit  L  minimizes  the  tail  error;  the  effects  of  both  of 
these  parcuneters  can  be  observed  from  sample  plots  of  the  distributions  and 
can  be  modified  if  needed.  Additionally,  shift  b  must  be  chosen  so  as  to 
yield  a  positive  random  variable  with  probability  virtually  1.  The  number  of 
distribution  values  yielded  depends  on  the  size  of  the  FFT  employed  and  can  be 
independently  selected  to  yield  the  desired  spacing  in  distribution  values. 
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APPENDIX  A.  SAMPLING  FOR  A  FOURIER  TRANSFORM 

Suppose  we  are  interested  in  evaluating  Fourier  transform 

G{f)  “  Jdt  exp(-i2iTft)  g(t).  (A-l) 

If  we  sample  at  interval  a  in  t  in  (A-l),  and  use  integration  weighting  w(t), 
we  have  the  approximation  to  G(f), 

G(f)  s  Jdt  exp(-i2irft)  g{t)  S^(t)  w(t) 

»  G(f)®iJ^(f)e  W{f) 

"a 

“a  ^^(f- J)ew{f).  {A-2} 

n 

where  infinite  impulse  train  (sampling  function) 

S^(t)  =^J(t-nA),  (A-3) 

n 


and  ©denotes  convolution. 

The  term 

f)  (A-") 

n 

in  (A-2)  is  an  infinitely  aliased  version  of  desired  function  G(f);  this 
aliasing  is  an  unavoidable  effect  due  to  sampling  at  increment  a.  However,  to 
minimize  any  further  aliasing  in  (A-2),  we  would  like  W(f )  =  <J(f),  which 
requires  w(t)  »  1  for  all  t;  strictly,  all  we  need  is 

w(nA)  »  1  for  all  n.  (A-5) 
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That  is,  the  best  weighting  in  (A-2)  is  uniform. 

As  an  example,  for  Simpson's  rule,  we  have  weighting 

w(nA)  *  ...»  -I*  -j,  -j,  -j,  -j,  ...»  1  +  or  1  -  -^{-1)”,  (A-6) 

which  can  be  represented  as  samples  of  time  function 

w(t)  =  1  +  exp(iirt/A)  or  1  -  -j  exp(iirt/A).  (A-7) 

The  corresponding  transform  is 

W(f)  “  Jdt  exp(-i2«ft)  w(t)  « 

-  W)  *  T  -  h)  O'-  )  -  5  -  Ij)  •  ('^8) 

Blit  this  window  function  substituted  in  (A-2)  results  in  an  extra  aliasing 
lobe  in  G(f),  halfway  between  the  unavoidable  major  lobes  of  (A-4)  at 
multiples  of  1/a,  of  magnitude  1/3  as  large.  This  effect  very  adversely 
affects  the  quality  of  2^(f)  insofar  as  its  approximation  to  the  desired  G(f) 
is  concerned.  Thus  the  best  sampling  plan  in  (A-2)  is  the  equal  weight 
structure  of  (A-5)  when  one  wants  to  approximate  the  Fourier  transform  of 
(A-1).  For  a  bounded  region,  this  is  modified  to  the  Trapezoidal  rule,  i.e., 
half-size  weights  at  the  boundaries. 
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APPENDIX  B.  LISTINGS  OF  PROGRAMS  FOR  FIVE  EXAMPLES 

The  following  listings  are  programs  in  BASIC  for  the  Hewlett  Packard 
9845B  Desktop  Calculator.  The  FFT  utilized  is  one  with  the  capability  of  a 
zero  subscript  and  is  listed  at  the  end  of  the  appendix.  Mathematically,  the 
FFT  programmed  is 


M-1 

^m  “  ^  exp(-i2irmk/M}  Zj^  for  0  £  m  <  M-1, 
k=*0 

where  the  arrays  and  are  handled  directly,  including  the  zero- 

subscript  terms  z^  and  Z^. 

A  detailed  explanation  of  the  first  program  below  for  Chi-Squared  random 
variables  is  as  follows:  line  20  specifies  the  parameter  K,  where  2K  is  the 
number  of  squared-Gaussian  random  variables  summed  to  yield  random  variable 
X.  Lines  30-60  require  inputs  L,  &,  b,  M  respectively,  on  the  part  of  the 

user.  Line  110  is  the  input  of  mean  of  random  variable  x,  as  evaluated 

analytically  from  characteristic  function  ^,^(5).  Lines  180-210  specifically 
evaluate  the  characteristic  function  fy(f)  at  general  point  f .  All  of  these 
lines  mentioned  thus  far  require  inputs  on  the  part  of  the  user  and  are  so 

noted  in  the  listing  by  the  presence  of  a  single  I  on  each  line;  the  comments 

after  a  double  I!  are  for  information  purposes  only  and  need  not  be  modified. 
This  convention  is  also  adopted  in  the  remaining  listings. 

Lines  220-240  accomplish  the  collapsing  operation  of  (32)-(33).  The 
cumulative  and  exceedance  distribution  functions  are  finally  evaluated  and 
stored  in  arrays  X(*)  and  Y{*)  in  lines  400-410. 

Some  further  elaboration  is  necessary  for  the  listing  of  the  Smirnov 
characteristic  function  as  given  by  (42),  Since  a  characteristic  function  is 
a  continuous  function  of  real  f ,  the  square  root  in  (42)  is  not  a  principal 
value  square  root,  but  in  fact  must  yield  a  continuous  function  in  f.  In 


B-1 


TR  No.  7023 

or'der  to  achiwe  this,  the  argument  of  the  square  root  is  traced  continuously 
f rom  (line  110).  If  an  abrupt  change  in  phase  is  detected,  a  polarity 

indicator  takes  note  of  this  fact  (line  250)  and  corrects  the  final  values  of 
characteristic  function  fy(y)  (lines  260-270).  No  problems  are  encountered 
with  complex  sin(z)  since  it  is  analytic  for  all  z. 


CHfiRftCTERISTIC  FUNCTION  2  xi>-'4 

2Ka8  d*gr*»s  of  freedom 
Limit  on  integral  of  ch*r.  function 
Sampling  increment  on  char,  function 
Shift  b 
Sire  of  FFT 


10  !  CHI-SQUflRE 
20  K«4 

30  L-200 

40  Delta*. 075 

50  Bs*0 

60  M»2'-8 

70  PRINTER  IS  0 

80  PRINT  "L  "Delta  »";Delta,  "b 

90  REDIM  X<0:M“1),Y<0:M-1) 

100  DIM  X<0: 1023), Y<0: 1023) 

110  Mux*2*K 

120  Muy*Mux+B» 

130  X<e>«0 

140  Y<0)». 5*De1 ta*Muy 

150  N«INT<L/De1ta) 

160  FOR  Ns«l  TO  N 

170  Xi«DeUa«Ns 

180  C»Xi+Xi 

190  CALL  Mul <1,-C, l,-C,fl,B) 

200  CALL  Mul <R,B,A,B,C,D) 

210  CALL  Diu<l,0,C,D,Fyr,Fyi ) 

220  Ms«Ns  MOD  M 

230  X<Ms)»X<Ms)+Fyr/Ns 
240  Y<Ms)*Y<Ms)+Fvi/Ns 
250  NEXT  Ns 

260  CALL  Fftl0z<M,X<*),Y<:*)) 


‘";Bs,  "M 


,M 


Mean  of  random  variable  x 


I  I 


Argument  xi  of  char.  fn. 
Calculation  of 
characteri  st  i  c 
f unct ion  f y <xi  ) 
for  K*4 
Col  I apsi ng 


0  subscript  FFT 
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270  PLOTTER  IS  "CRfiPHICS" 

280  GRAPHICS 

290  SCALE  0,ri,-14,0 

300  LINE  TVPE  3 

310  GRID  M/8,1 

320  PENUP 

330  LINE  TYPE  1 

340  t«/'<2«PI  >  !!  Origin  for  random  M«ri«ib1*  x 

350  HOVE  B,0 

360  DRAW  B,>14 

370  PENUP 

380  FOR  Ks-0  TO  M-l 

390  T»Y<K»)/'PI-K»/M 

400  X(Ks>».5-T  !!  CumulAtiv*  probability  in  X<«> 

410  Y<Ks>»Pr«. 5+T  ?!  Exccadanc*  probability  in  Y<*> 

420  IF  Pr>-1E-12  THEN  Y«LGT<Pr) 

430  IF  Pr<  — 1E-'12  THEN  Y—24“LGT<-Pr) 

440  IF  ABS<Pr><lE-12  THEN  Y»-12 

450  PLOT  Ks,Y 

460  NEXT  Ks 

470  PENUP 

480  PRINT  Y<0);Y<1); Y<M-2); Y<M-1) 

490  FOR  Ks-0  TO  M-1 

500  Pr-X<Ks> 

510  IF  Pr>-1E-12  THEN  Y-LGT<Pr) 

520  IF  Pr<  — lE-12  THEN  Y— 24“LGT<-Pr> 

530  IF  RBS<PrXlE-12  THEN  Y— 12 

540  PLOT  Kt,Y 

550  NEXT  Ks 

560  PENUP 

570  PAUSE 

580  DUMP  GRAPHICS 

590  PRINT  LIN<5) 

600  PRINTER  IS  16 

610  END 

620  I 

630  SUB  I1U1<X1,Y1.X2,Y2,A,B)  !  Z1«Z2 

640  A-X1*X2-Y1*Y2 

650  B«X1*Y2+X2*Y1 

660  SUBEND 

670  I 

680  SUB  Div<Xl,Yl,X2,Y2,A,B>  !  Z1/Z2 

690  T-X2»X2+Y2*Y2 

700  A-<X1*X2+Y1*Y2>/T 

710  B«<Y1*X2-X1#Y2)^T 

720  SUBEND 

730  I 

740  SUB  !  N  <»  2-^10  ■  1024,  N-Z-^INTEGER  0  subscript 
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10  !  GAUSSIAN  CHARACTERISTIC  FUNCTION  exp< 
20  L»7  !  Limit  on  int 

30  Delta*. 3  !  Sampling  i nc 

40  B»=.  375*<2*PI/"D©1  ta)  !  Shift  b,  as 

50  M*2^8  .  !  Size  of  FFT 

60  PRINTER  IS  0 

70  PRINT  "L  "Delta  *";De1ta,"b 

80  REDIM  X<0;M-1>,Y<0;M-1) 

90  DIN  X<0; 1023), Y<0: 1023) 

100  Mux*0  ! 

110  Muy*Mux+Bs 

120  X<0)>0 

130  Y<0)*.5*Delta*Nuy 

140  N*INT<L^DeUa) 

150  FOR  Ns*l  TO  N 

160  Xt«DeUa«Ns  M 

170  A»EXP<-.5*XieXi )  ! 

180  B*Bs*Xi  < 

190  Fyr»A*C0S<B)  ! 

200  Fyi*A«SIN<B)  ! 

210  Ms*Ns  MOD  M  !  ! 

220  X<Ms)*X<Ms)+Fyr^Ns 

230  Y<Ms)»Y<Ms)+Fyi/Ns 

240  NEXT  Ns 

250  CALL  Fftl0z<M,X<*),Y<*>)  M 

260  PLOTTER  IS  "GRAPHICS" 

270  GRAPHICS 

260  SCALE  e,M,-14,0 

290  LINE  TYPE  3 

300  GRID  M/8,1 

310  PENUP 

320  LINE  TYPE  1 

330  B»Bs*M»De1ta/<2*PI)  !! 

340  MOVE  6,0 

350  DRAM  B,-14 

360  PENUP 

370  FOR  Ks*0  TO  M-1 

380  T*Y<Ks)/PI-Ks/M 

390  X<Ks)*.5-T  !  ! 

400  Y<Ks)»Pr*.5+T  !! 

410  IF  Pr>-1E-12  THEN  Y*LGT<Pr) 

420  IF  Pr<  — lE-12  THEN  Y»-24-LGT<-Pr) 

430  IF  ABS<Pr)<lE-12  THEN  Y*-12 

440  PLOT  Ks,Y 

450  NEXT  Ks 

460  PENUP 

470  PRINT  Y<0);Y<1);Y<M-2);Y<M-1) 

480  FOR  Ks»0  TO  M-l 

490  Pr*X<Ks) 

500  IF  Pr>-1E-12  THEN  Y»LGT<Pr) 

510  IF  Pr<  — lE-12  THEN  Y»-24-LGT<-Pr) 

520  IF  ABS<Pr)<lE-12  THEN  Y«-12 

530  PLOT  Ks,Y 

540  NEXT  Ks 

550  PENUP 

560  PAUSE 

570  DUMP  GRAPHICS 

580  PRINT  LIN<5) 

590  PRINTER  IS  16 

600  END 

610  ! 

620  SUB  Fftl0z<N,X<*),Y<e)) 


-.5  xi ^2) 

egral  of  char,  function 
rement  on  char,  function 
fraction  of  alias  interval 


Bs,  "M 


Mean  of  random  variable  x 


Argument  xi  of  char, 
Calculation  of 
character i  st  i  c 
funct i on 
fy<xi ) 

Col  1 apsi ng 


0  subscript  FFT 


Origin  for  random  variable 


Cumulative  probability  in  X<*) 
Exceedance  probability  in  Y(*) 


!  N  <*  2-^10  »  1024,  N»2''INTEGER 


0  subscr 
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10  ! 

SMIRNOV  CHflRfiCTERISTIC 

FUNCTION  Cs/si  n<s)  ]''l/2  where  s» <  1  +  i  )sqr C x i  ) 

20 

L=3000 

!  Limit  on 

integral  of  char,  function 

30 

Del ta=l 

!  Sampi i ng 

increment  on  char,  function 

40 

Bs=0 

•  Shift  b 

50 

M*2'^8 

!  Size  of  FFT 

60 

PRINTER  IS  0 

70 

PRINT  "L  =";L, "Delta 

=";Delta, "b 

_  ti . 
~  » 

Bs, "M  *";M 

30 

REDIM  X<0:M-1 ),Y<0:M- 

1 ) 

90 

DIM  X<0; 1023), Y<0; 1023) 

100 

Mux*  1  ^6 

! 

Mean  of  random  variable  x 

110 

R*0 

! 

Argument  of  square  root 

120 

P*l 

! 

Polarity  indicator 

130 

Muv*Mux+Bs 

140 

X<0)*0 

150 

Y<0)=. 5«Del ta*Muv 

160 

N*INT<LxDe1ta) 

170 

FOR  Ns*l  TO  N 

180 

Xi ®De 1 ta*Ns 

!  ! 

Argument  xi  of  char.  fn. 

190 

fl*SQR<Xi ) 

! 

Cal cul at i on 

200 

CfiLL  Sin<fl,fl,B,C) 

j 

of 

210 

CALL  Diu<fl,ft,B,C,D,E) 

1 

character! st i c 

220 

CfiLL  Sqr<D,E,fi,B) 

! 

f unct i on 

230 

Ro*R 

! 

fy<xi  ) 

240 

R*ATN<B/'fi) 

! 

250 

IF  flBS<R“Ro)>1.6  THEN 

CL 

1 

II 

CL 

! 

260 

Fyr*fi*P 

! 

270 

Fy  i  *B*P 

! 

280 

Ms*Ns  MOD  M 

!  j 

Col  1 apsi ng 

290 

X<Ms)*X<Ms>+Fyr/Ns 

300 

Y<Ms)*Y<Ms)+Fyi/Ns 

310 

NEXT  Ns 

320 

CfiLL  Fftl0z<M,X<*), Y<*)) 

!  ! 

0  subscript  FFT 

330 

PLOTTER  IS  "GRAPHICS" 

340 

GRAPHICS 

350 

SCALE  0,M,-14,0 

360 

LINE  TYPE  3 

370 

GRID  M/8,  1 

380 

PENUP 

390 

LINE  TYPE  1 

400 

B=Bs*M*DeUa/<2*PI ) 

!  I 

Origin  for  random  variable  x 

410 

MOVE  B,0 

420 

DRfiW  B,-14 

430 

PENUP 

440 

FOR  Ks»0  TO  M-1 

450 

T=Y<Ks)/PI-Ks/M 

460 

X<Ks)*.5-T 

!  ! 

Cumulative  probability  in  X<*> 

470 

Y<Ks)*Pr*. 5+T 

!  ! 

Exceedance  probability  in  Y<») 

480 

IF  Pr>»lE-12  THEN  Y==LGT<Pr) 

490 

IF  Pr<*-1E-12  THEN  Y= 

-24-LGT<-Pr) 

500 

IF  RBS<Pr)<lE-12  THEN 

Y*-12 

510 

PLOT  Ks,Y 

520 

NEXT  Ks 
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530 

540 

550 

560 

570 

580 

590 

600 

6i0 

620 

630 

640 

650 

660 

670 

680 

690 

700 

710 

720 

730 

740 

750 

760 

770 

780 

790 

800 

810 

820 

830 

840 

850 

860 

870 

880 

890 

900 

910 

920 

930 

940 

950 

960 

970 

980 

990 

1000 

1010 

1020 

1030 

1040 


B“6 


PENUP 

PRINT  Y<0);Y<l>;Y<M'2);Y<ri-l> 

FOR  Ks«0  TO  M-l 
Pr«X<K»> 

IF  Pr>»iE-12  THEN  Y»LGT<Pr> 

IF  Pr<  — 1E'-12  THEN  Y— 24-LCT<-Pr> 

IF  flBS<Pr><lE-12  THEN  Y— 12 

PLOT  K»,Y 

NEXT  Ks 

PENUP 

PRUSE 

DUMP  GRAPHICS 
PRINT  LIN<5> 

PRINTER  IS  16 
END 

I 

SUB  Div<Xl,Yl,X2, Y2,fl,B)  !  21/Z2 

T»X2*X2+Y2*Y2 
fl»<Xl*X2+Yl*Y2>/'T 
B»<Y1*X2-X1*Y2)/T 
SUBEND 
! 

SUB  Sqr<X,Y,fl,B)  I  PRINCIPAL  SQR<Z) 

IF  X<>0  THEN  800 

A«B»SQR<.5«ABS<Y>> 

IF  Y<e  THEN  B— B 
GOTO  910 

F-SQR<SQR<X*X+Y«Y>> 

T».5*ATN<Y^X) 

A»F*COS<T) 

B-F*SIN<T) 

IF  X>0  THEN  910 

T-A 

A«-B 

B-T 

IF  Y>«0  THEN  910 

A»-A 

B— B 

SUBEND 

! 

SUB  S1n<X,Y,A,B)  !  SIN<Z> 

E«EXP<Y> 

A-.5*8IN<X>*<E+1/E) 

IF  ABS<Y)<.1  THEN  998 
S-.5*<E-1/E) 

GOTO  1010 
S»Y*Y 

8»Y*<120+S#<20+S)><'120 
B»C0S<X>*8 
SUBEND 
J 

SUB  Fftl0z<N,X<#),Y<*)) 


i 


I  N  <-  Z'^IO  -  1024,  N»2''INTEGER 


0  subscrii 
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10  !  NON-CENTRflL  CHI-SQUflRE  CHARACTERISTIC  FUNCTION 
20  !  exp<i  (1-^2  xi  /  s)  x  s^nu  where  s  ■  1-i  2  xi 
30  Nu«2.7  !  Power  lew  nu 

40  Ds*3  !  Deflection  d 

50  L*500  !  Limit  on  integrel  of  cher.  function 

60  Deltas. 05  !  Sampling  increment  on  char,  function 

70  Bs*0  !  Shift  b 

80  M»2''8  !  Size  of  FFT 

90  PRINTER  IS  0 


100  PRINT  "L  s";L, "Delta  »";Delta,"b 
110  REDIM  X<0;M-1>, Y<0:M-1) 

120  DIM  X<0: 1023>,Y<0: 1023) 

130  D2sDs*Ds 
140  Mux*2*Nu+D2 
150  Muy»Mux+B» 

160  X<0)s0 

170  Y<0)*. 5*De1 ta*Muy 

180  N>INT<L/De1ta> 

190  FOR  Ns*l  TO  N 
200  Xi»Delta*Ns 
210  T»Xi+Xi 

220  CALL  Diw<0,D2*Xi , 1,-T,A,B) 

230  CALL  Log<l,-T,C,D) 

240  CALL  Exp<A-Nu*C,B-Nu*D+Bs*Xi ,Fyr 

250  MssNs  MOD  M 

260  X<M*)»X<Ms)+Fyr/Ns 

270  Y<Ms>*Y<Ms>-t-Fyi/Ns 

280  NEXT  Ns 

290  CALL  Fftl02<M,X<*),Y<*)> 

300  PLOTTER  IS  "GRAPHICS" 

310  GRAPHICS 

320  SCALE  0,M,-14,0 

330  LINE  TYPE  3 

340  GRID  MX8, 1 

350  PENUP 

360  LINE  TYPE  1 

370  BsBs*M*DeUa/'<2*PI) 

380  MOVE  6,0 

390  DRAM  B,<14 

400  PENUP 

410  FOR  Ks-0  TO  M-1 

420  T»Y<Ks)xPl-Ks/M 

430  X<Ks)-.5-T 

440  Y<Ks)»Pr=.5+T 

450  IF  Pr>-1E-12  THEN  Y-LGTCPr) 

460  IF  Pr<  — lE-12  THEN  Y— 24-LGT<-Pr 
470  IF  ABS<Pr)<lE-12  THEN  Y— 12 
480  PLOT  Ks,Y 

490  NEXT  Ks 

500  PENUP 


»";Bs,"M  -";m 


!  Calculate  parameter 
!  Mean  of  random  variable  x 


! !  Argument  xi  of  char.  fn. 
!  Calculation  of 
!  characteristic 
1  function 
,Fyi>  !  fy<xi> 

M  Coll apsi ng 


• !  0  subscript  FFT 


M  Origin  for  random  variable  x 


!!  Cumulative  probability  in  XC*> 
!!  Exceedance  probability  in  Yt*> 


B-7 


TR  No.  7023 


5i0  PRINT  Y<0);Y<1);Y<M-2>;Y<M-I> 

520  FOR  Ks-0  TO  M-1 
530  Pr=X<Kft> 

540  IF  Pr>«lE-12  THEN  Y»LGT<Pr) 

550  IF  Pr<  — lE-12  THEN  Y»-24-LGT<-Pr> 

560  IF  flBS<Pr)<lE-12  THEN  Y—12 

570  PLOT  Ks,Y 

580  NEXT  Ks 

590  PENUP 

600  PRUSE 

610  DUMP  GRAPHICS 

620  PRINT  LIN<5> 

630  PRINTER  IS  16 

640  END 

650  ! 

660  SUB  D1v<Xl,Yl,X2,Y2,R,B>  !  21/22 

670  T»X2*X2+Y2*Y2 

680  R»<X1*X2+Y1*Y2)/T 

690  B*<Y1*X2'X1*Y2)/T 

700  SUBEND 

710  ! 

720  SUB  Exp<X,Y,fl,B)  }  EXP<2) 

730  T»EXP<X) 

740  flsT*COS<Y> 

750  B«T»SIN<Y) 

760  SUBEND 

770  i 

780  SUB  Log<X,Y,R,B)  !  PRINCIPAL  L0G<2> 

790  fl*.5*L0G<X*X+Y*Y) 

800  IF  XO0  THEN  830 
810  B».5*PI*SGN«:Y) 

820  GOTO  850 

830  B»RTN<Y/X) 

840  IF  X<0  THEN  B=B+PI*< 1-2»<Y<0) ) 

850  SUBEND 

860  ! 

870  SUB  Fftl0z<N,X<*),  Y<*))  !  N  <=  2''10  =  1024,  N=2'^INTEGER  0  subscri 
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10  !  GAUSSIAN  PRODUCT  CHARACTERISTIC  FUNCTION  <56) 

20  Nu®7.7  !  Power  Nu 

30  Rho*-.3  !  Correlation  coefficient 

40  L-5  !  Limit  on  integral  of  char,  function 

50  Deltas. 06  !  Sampling  increment  on  char,  function 

60  Bs= .  5*  <2*P  I ''De  1 1  a)  !  Shift  b,  as  fraction  of  alias  interval 

70  !  Size  of  FFT 

80  PRINTER  IS  0 

90  PRINT  "L  "Delta  =";Delta,‘'b  =”;Bs,"M  s";l1 

100  REDIM  X<0;M-n,Y<0:M-l) 

110  DIM  X<0: 1023), Y<0: 1023) 

120  Tl»l-Rho*Rho  1  Calculate 

130  T2*2*Rho  !  parameters 

140  Mux=2*Nu*Rho  !  Mean  of  random  variable  x 

150  Muy*Mux+Bs 

160  X<0)S0 

170  Y<0)*.5*Delta*Muy 

180  N*INT<L/DeUa) 

190  FOR  Ns>l  TO  N 

200  XisDelta*Ns  !!  Argument  xi  of  char,  fn. 

210  CALL  Log< l+Tl*Xi *Xi , -T2*Xi , A, B)  !  Calculation  of 

220  CALL  Exp<-Nu*A, Bs*Xi -Nu*B, Fyr, Fyi ) !  characteristic  function  fy<xi) 

230  Ms*Ns  MOD  M  I!  Collapsing 

240  X<Ms)-X<Ms)+Fyr>'Ns 

250  Y<Ms)»Y<Ms)+Fyi/Ns 

260  NEXT  Ns 

270  CALL  Fftl02<M,X<*), Y<*))  !!  0  subscript  FFT 

280  PLOTTER  IS  "GRAPHICS" 

290  GRAPHICS 

300  SCALE  0,M,-14,0 

310  LINE  TYPE  3 

320  GRID  M/8,  1 

330  PENUP 

340  LINE  TYPE  1 

350  B*Bs*M*Del ta/<2*PI )  !!  Origin  for  random  variable  x 

360  MOVE  B,0 

370  DRAM  B,-14 

380  PENUP 
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FOR  Ks=0  TO  M-1 
T*Y<Ks)/PI-Ks/M 
X<Ks)*.5-T 
Y<Ks)=Pr=.5+T 

IF  Pr>=lE-12  THEN  Y=LGT<Pr> 

IF  Pr<=-1E-12  THEN  Y=-24-LGT<-Pr > 
IF  flBS<Pr)<lE-l2  THEN  Ys-12 
PLOT  Ks,Y 
NEXT  K» 

PENUP 

PRINT  Y<0); Y<1);Y<M-2);Y<M-1> 

FOR  Ks=0  TO  M-1 
Pr=X<Ks) 

IF  Pr>=lE-12  THEN  Y=LGT<Pr) 

IF  Pr<=-1E-12  THEN  Y=-24-LGT<-Pr) 

IF  flBS<Pr)<lE-12  THEN  Y»-12 

PLOT  K*,Y 

NEXT  Ks 

PENUP 

PAUSE 

DUMP  GRAPHICS 
PRINT  LIN<5) 

PRINTER  IS  16 
END 


!!  Cutnul4^tive  probability  in  X(*) 
M  Exceedance  probability  in  Y<*) 


SUB  Exp<X,Y,R,B) 

T-EXP<X) 

R»T*COS<Y) 

B«T*SIN<Y) 

SUBEND 

! 

SUB  Log<X,Y,A,B) 
A«.5*L0G<X*X+Y*Y> 

IF  XO0  THEN  750 
B-.5#PI*SGN<Y) 

GOTO  770 
B»ATN<Y/X) 

IF  X<0  THEN  B»B+PI*<1-2*<Y<0>) 
SUBEND 


EXP<2> 


PRINCIPAL  LOGCZ) 


SUB  Fftl0z<N,X<«),Y<*)) 


•  N  <«  Z-'ie  »  1024,  N»2^INTEGER 


0  subscript 


B-10 
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10  SUB  Fft.l0z<N,X(:*),  ?<;*>>  !  H  <=  2-10  =  1024,  N  =  2'IHTEGER  0  subscript 

20  DIM  Ci:0:256) 

30  INTEGER  1 1 , 12, 13,  14, 15, 16,  17, 18, 19, 1 10, J, K 

40  DfllFI  1, .999981175233, .999924701839, .999830581796, . 9996988 1 8596 , .9995294175 
01 , . 999322384588, . 999077727753, . 998795456295, . 998475580573, . 998118112900 
50  DATA  . 997723066644, . 997290456679, . 99682029929 1 , . 996312612183, . 995767414468 
, .995184726672, .994564570734, .993906970092, .993211949235, .992479534599 
60  DATA  . 991709753669, . 990902635428, . 990058210262, . 989176509965, . 988257567731 
, .987301418158, .986308097245, .985277642389, .984210092387, .983105487431 
70  DATA  . 981963869110, . 980785280403, . 979569765685, . 978317370720, . 977028142658 
, .975702130039, .974339382786, .972939952206, .971503890986, .970031253195 
80  DATA  . 968522094274, . 966976471045, .965394441698, . 963776065795, . 962121404269 

, . 960430519416, . 958703474896, . 956940335732, . 955141168306, . 953306040354 
90  DATA  . 951435020969, . 949528180593, . 947585591018, . 945607325381 , . 943593458162 
, .941544065183, .939459223602, .937339011913, .935183509939, .932992798835 
100  DATA  . 930766961079, . 928506080473, .926210242138, .923879532511 , .921514039342 
, .919113851690, .916679059921, .914209755704, .911706032005, .909167983091 
110  DATA  .906595704515, .903989293123, .901348847046, .898674465694, .895966249756 
, .893224301196, .890448723245, .887639620403, .884797098431, .881921264348 
120  DATA  .879012226429, . 876070094 1 95 ,. 8730949784 1 8 , .870086991109, .867046245516 
, .863972856122, .860866938638, .857728610000, .854557988365, .851355193105 
130  DATA  .848120344803, . 844853565250, . 841554977437, .838224705555, .834862874986 
, . 831469612303, . 828045045258, . 824589302785, . 821102514991, .817584813152 
140  DATA  .814036329706, .810457198253, . 806847553544, . 80320753 1 48 1 , . 799537269108 
, . 795836904609, . 792106577300, . 788346427627, . 784556597156, . 780737228572 
150  DATA  .776888465673, .773010453363, .769103337646, .765167265622, .761202385484 
, . 757208846506, . 753186799044, . 749136394523, . 74505778544 1 , . 740951125355 
160  DATA  .736816568877, . 73265427 1 672 ,. 728464390448 , .724247082951, .720002507961 
, .715730825284, .711432195745, . 707106781187, . 702754744457, . 698376249409 
170  DATA  .693971460890, .689540544737, .685083667773, ,680600997795, .676092703575 
, .671558954847, . 666999922304 , . 662415777590, . 657806693297, .653172842954 
180  DATA  .648514401022, .643831542890, .639124444864, .634393284164, .629638238915 
, .624859488142, .620057211763, . 615231590581 ,. 610382806276, .605511041404 
190  DATA  .600616479384, .595699304492, .590759701859, .585797857456, .580813958096 
, .575808191418, .570780745887, .565731810784, .560661576197, .555570233020 
200  DATA  . 550457972937, . 545324988422, . 540171472730, . 534997619887, . 529803624686 
, . 524589682678, .519355990166, .514102744193, . 508830142543, .503538383726 
210  DATA  .498227666973, . 4928981 92230, . 4875501 60 1 48 , .482183772079, .476799230063 
, .471396736826, . 465976495768 , .460538710958, .455083587126, .449611329655 
220  DATA  . 444122144570, . 438616238539, . 433093818853, . 427555093430, . 422000270800 
, .416429560098, .410843171058, .405241314005, .399624199846, .393992040061 
230  DATA  .388345046699, .382683432365, .377007410216, .371317193952, .365612997805 
, . 359895036535, . 354163525420, . 348418680249, . 342660717312, . 336889853392 
240  DATA  . 331106305760, . 325310292162, .319502030816, .313681740399, . 307849640042 
,  .302005949319, .296150888244, .290284677254, .284407537211, .278519689385 
250  DATA  .272621355450, .266712757475, . 2607941 17915, . 254865659605, .248927605746 
, .242980179903, .237023605994, .231058108281, ,225083911360, .219101240157 
260  DATA  .213110319916, .207111376192, .201104634842, . 195090322016, . 189068664150 
, . 183039887955, . 177004220412, . 170961888760, . 164913120490, . 158858143334 
270  DATA  . 152797185258, . 146730474455, . 140658239333, . 134580708507, . 1284981 10794 
,  .  122410675199, . 116318630912, .  1 10222207294, .  104121633872, . 980 1 7 1 403296E- 1 
280  DATA  . 919089564971E-1 , . 857973 1 23444E- 1 , . 7968243797 1 4E- 1 , . 735645635997E- 1 , . 
6744391 95637E-1 , .6132073630226-1 , . 5S1952443497E-1 , . 490676743274E- 1 
290  DATA  .429332569349E-1, . 36S072229414E-1 , . 30674803 1 766E- 1 , . 2454 1 2285229E- 1 , . 
184067299058E-1, . 122715382857E-1 , . 613588464915E-2, 0 
300  READ  C(*) 

310  K*1024rN 

320  FOR  J*0  TO  N/4 
330  C<J>-C<K*J) 

340  NEXT  J 
350  Nl»N/'4 

360  N2-N1+1 

370  N3-N2+1 


B-n 
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380 

N4*N1+N3 

390 

Log2n«INT<1.4427*L0G<N)+.5) 

400 

FOR  11*1  TO  Log2n 

4i0 

I2»2''<Log2n-ll) 

420 

13*2*12 

430 

I4»N/13 

440 

FOR  15*1  TO  12 

450 

16*< 15-1 )*14+1 

460 

IF  16<»N2  THEN  500 

470 

N6»-C<N4-16-1 ) 

480 

N7*-C< 16-N1-1> 

490 

GOTO  520 

500 

N6*C<16-1) 

510 

N7s-C<N3-16-1  ) 

520 

FOR  17*0  TO  N-13  STEP 

13 

530 

18*17+15 

540 

19*18+12 

550 

N8»X< 18-1 )-X< 19-1 ) 

560 

N9»Y<I8-I)-V<19-1) 

570 

X<18-n*X<18-l)+X<19-l) 

580 

Y< 18-1 )»Y< 18-1 )  +  Y< 19-1  ) 

590 

X<  19-1 )»N6*N8-N7*N9 

600 

Y<I9-1)»N6*N9+N7*N8 

610 

NEXT  17 

620 

NEXT  15 

630 

NEXT  11 

640 

1 1 *Log2n+l 

650 

FOR  12*1  TO  10 

660 

C<12-n*l 

670 

IF  12>Log2n  THEN  690 

680 

C<12-1)*2''<11-12) 

690 

NEXT  12 

700 

K»1 

710 

FOR  11*1  TO  C<9) 

720 

FOR  12*11  TO  C<8)  STEP 

C<9) 

730 

FOR  13*12  TO  C<7)  STEP 

C<8) 

740 

FOP  14*13  TO  C<6)  STEP 

C<7) 

750 

FOR  15*14  TO  C<5)  STEP 

C<6) 

760 

FOR  16*15  TO  C<4)  STEP 

0(5) 

770 

FOR  17*16  TO  C<3)  STEP 

C<4) 

780 

FOR  18*17  TO  C(2)  STEP 

C<3> 

790 

FOR  19*18  TO  C<1)  STEP 

C<2) 

800 

FOR  110*19  TO  C<0)  STEP  C<1) 

810 

J*110 

820 

IF  K>J  THEN  890 

830 

fi*X<K-l ) 

840 

X<K-1 )»X< J-l> 

850 

X<J-l)sfl 

860 

fi*Y<K-l) 

870 

Y<K-1 )*Y< J-1 ) 

880 

Y< J-1 )*fl 

890 

K*K  +  1 

900 

NEXT  110 

910 

NEXT  19 

920 

NEXT  18 

930 

NEXT  17 

940 

NEXT  16 

950 

NEXT  15 

960 

NEXT  14 

970 

NEXT  13 

980 

NEXT  12 

990 

NEXT  11 

1000 

SUBENO 

2''10*1024 
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Gaussian  Inputs 


A.  H.  NuttaU 

ABSTRACT 

The  characteristic  function  of  general  second-order  processors  with 
nonstationary  nonzero  mean  Gaussian  inputs  is  derived  in  closed  form. 
Three  classes  of  processors  are  considered;  in  the  first,  the  decision 
variable  is  the  sum  of  K  independent  terms,  each  of  second-order  form 
involving  two  statistically  dependent  Gaussian  random  variables;  the 
second  class  of  processor  is  a  narrowband  crosscorrelator  of  arbitrary 
Gaussian  processes,  with  accumulation  of  K  independent  lowpass  filter 
output  samples;  in  the  third  class,  the  decision  variable  is  a  general 
quadratic-plus-linear  form  of  M  random  variables,  all  statistically 
dependent  on  each  other.  Specializations  to  various  forms  of  weighted 
energy  detectors  and  correlators  are  made.  Also,  the  characteristic 
function  for  the  first  class  of  processor  subject  to  fading  is  evaluated. 

Programs  for  evaluating  the  cumulative  and  exceedance  distribution 
functions  of  all  three  classes  of  processors  are  given  and  have  been  used 
to  plot  representative  examples  of  performance.  A  comparison  with  a 
simulation  result  corroborates  the  analysis  and  program  of  the  first 
class  of  processor. 
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EXACT  PERFORMANCE  OF  GENERAL  SECOND-ORDER 
PROCESSORS  FOR  GAUSSIAN  INPUTS 

INTRODUCTION 

The  performance  of  weighted  energy  detectors  and  correlators  for 
processing  deterministic  and/or  random  signals  in  the  presence  of 
nonstationary  noise  is  a  topic  of  frequent  interest.  Most  often,  a  second- 
moment  approach  is  adopted,  whereby  the  means  and  variances  of  the  decision 
variable  under  the  various  hypotheses  are  evaluated  and  employed  in  a  central 
limit  assumption  to  get  approximate  false  alarm  and/or  detection  probabilities. 
This  approach  is  suspect  for  small  false  alarm  probabilities  or  for  cases 
where  the  decision  variable  is  not  the  sum  of  a  large  number  of  independent 
random  variables  all  of  comparable  variance. 

A  recent  technical  report  [1]  has  presented  an  accurate  and  efficient 
method  for  evaluating  cumulative  and  exceedance  distribution  functions 
directly  from  characteristic  functions.  This  approach  is  very  fruitful  for 
determining  the  performance  of  general  time-varying  second-order  processors 
with  nonstationary  nonzero  mean  Gaussian  inputs,  since  the  characteristic 
function  of  the  decision  variable  can  be  evaluated  in  closed  form  in  these 
cases. 

We  will  consider  three  classes  of  processors  and  derive  the 
characteristic  functions  for  all  three  decision  variables  in  closed  form.  The 
first  two  classes  are  special  cases  of  the  third,  but  are  of  interest  in  their 
own  right,  since  they  include  and  immediately  reduce  to  many  practical 
processors  in  current  use.  Also  there  is  no  need  to  solve  for  the  eigenvalues 
and  eigenvectors  of  a  general  symmetric  matrix  that  is  encountered  in  the 
third  more-general  class  of  processors.  Rather,  the  characteristic  functions 
are  given  directly  in  terms  of  specified  processor  weights  and  input 
statistics. 

There  has  been  considerable  effort  on  this  problem  in  the  past;  for 
example,  see  [2,3]  and  the  references  listed  therein.  Most  of  the  lengthy 
analytical  derivations  and  results  have  been  aimed  at  getting  workable 
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expressions  for  the  probability  density  function  and/or  cumulative 
distribution  function.  Here,  when  we  consider  our  three  classes  of 
processors,  we  encounter  characteristic  functions  which  are  more  general  than 
that  given  in  the  recent  paper  for  a  filtered  analog  processor  [3,  eq.  5]; 
thus  specialization  of  our  results  will  yield  those  of  [3]  and  the  references 
listed  therein.  The  technique  employed  here  to  proceed  directly  to  the 
cumulative  and  exceedance  distribution  functions  is  a  numerical  one,  as  given 
in  [1],  and  does  not  require  any  series  expansions  or  analytical  manipulations 
at  all.  The  asymptotic  behaviors  of  the  cumulative  and  exceedance 
distribution  functions  on  both  tails  are  easily  observed  and  will  be  found  to 
corroborate  the  comment  made  in  [3,  p.  673]  that  these  tails  are  generally 
exponential  rather  than  Gaussian;  however,  there  can  be  a  considerable 
transition  region. 

The  programs  listed  in  the  appendices  require  the  user  merely  to  input 
his  processor  weights,  signal  constants,  and  noise  statistical  parameters  in  a 
series  of  data  statements  at  the  top  of  the  program,  and  to  select  values  for 

L,  limit  on  integral  of  characteristic  function, 

A,  sampling  increment  on  characteristic  function, 

b,  additive  constant,  to  guarantee  a  positive  random  variable,  and 

M^r,  size  of  FFT  and  storage  required. 

Selection  of  L  and  a  is  largely  a  matter  of  trial  and  error  and  is  amply 
documented  in  the  examples  in  [1]. 
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A  PARTICULAR  SECOND-ORDER  PROCESSOR 


Before  we  embark  on  the  analysis  of  the  particular  second-order  processor 
of  interest  in  this  section,  we  solve  the  following  simpler  statistical 
problem.  Let  s  and  t  be  real  jointly-Gaussian  random  variables  wi . i  means 
m^,  m^,  standard  deviations  and  correlation  coefficient  p; 

thus  s  and  t  are  statistically  dependent.  Consider  the  random  variable 

X  *  as^  +  bt^  +  cst  +  ds  +  et,  (1) 

where  weightings  a,  b,  c,  d,  e  are  arbitrary  real  constants.  The 
characteristic  function  of  random  variable  x  is  defined  by* 


=  exp(ifx)  =  exp(if  (as^  +  bt^  +  cst  +  ds  +  et))  = 

=  exp(i5(au^  +  bv^  +  cuv  +  du  +  ev))  Pg^(u,v), 

where  the  joint  probability  density  function  of  s  and  t  is 


Pst(i'»v)  =  exp  - 


2  2 

4i-m  \  /v-mA  ^-m  \  / v-m^ 

- i)  +  /_t  .  2„/_s  /_t 

^°s/  [  ’’t/  I  °sy\  "t; 

2(l-P^) 


.  (3) 


Substitution  of  (3)  in  (2)  and  use  of  the  double  integral 

r  2  2  ” 

ffdx  dy  exp[-ax^  -  py^  +  2Yxy  +  ux  +  vy]  =  -  ^  ■  exp  ~ — 

JJ  j 


for  >0,  8^  >  0,  0^8^  >  Ty.  . 


*  Integrals  without  limits  are  over  (-«,+•»). 
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(where  sub  r  denotes  the  real  part  of  complex  constants  a,  a,  y»  '») 
yields,  after  an  extensive  amount  of  manipulations,  the  characteristic 
function  of  random  variable  x  as  the  compact  closed  form  expression 


f 


X 


"o  - 

1  -  lyoj  - 


(5) 


The  required  real  constants  in  (5)  are  given  directly  in  terms  of  the 
processor  weights  and  statistical  parameters  as 


D 

D 

N 

N 


1 

2 

0 

1 


=  2(ao^  +  bo^  +  cpa^a^)  , 

=  (4ab  -  c^)(l  -  , 

2  2 

=  am^  +  bm^  +  *  ^"’s  *  ^’"t  » 

r^\(^  2^1  2  2  mm  ^ 

a  (4ab  -  c  )(2  m^o^  +  m^a^  -  om^m^o^o^) 

+  (2ae  -  cd)a^(m^ff^  -  pm^o^)  + 

+  (2bd  -  ce)a^(m^o^  -  pfn^o^)  - 


+ 


/I  .2  2  .  1  2  2  .  V 

-  d  e  +  depcr^a^j  , 

N2  =  -  (ae^  +  bd^  -  cde)(l-p^)ff^a^ 

For  later  reference,  the  mean  and  variance  of  x  follow  from  (5),  upon 
expansion  of  j^n  in  a  power  series  in  T,  as 


(6) 


“x  "  ^0  2  ^1* 


(7) 
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(When  Dj  =  0  in  (6),  it  can  be  shown  that  D2  <  0;  thus  characteristic 
function  (5)  never  possesses  any  singularities  along  the  real  f  axis.) 

Second-Order  Processor 


Now  let  X  be  the  sum  of  K  independent  terms  of  the  form  of  (1): 


K 


=  1 


k=l 


(8) 


where  real  constants  a|^,  b|^,  C|^,  d|^,  e|^  can  depend  arbitrarily  on  k, 
and  where  means  m^j^,  m^|^,  standard  deviations  o^|^,  and  corre¬ 
lation  coefficients  p|^  are  unrestricted  (except  that  _>  0,  >  0, 

l^kl  -  random  variables  S|^,  t|^  is  statistically 

independent  of  the  pair  S|^,  t^  for  all  k  ^  n.  Thus  random  variable  x  is 
composed  of  a  sum  of  K  groups  of  random  variables,  where  each  group  is 
statistically  independent  of  every  other  group,  but  each  group  itself 
contains  two  statistically  dependent  random  variables. 


This  processor  in  (8)  is  the  general  form  of  interest  in  this  section. 
It  can  be  time-varying  when  the  weights  |^a|^,  b|^,  C|^,  dj^,  e|^^  vary 
with  k,  and  nonstationary  when  the  statistical  parameters  m^j^, 

®sk*  ®tk*  •’kl 

The  characteristic  function  of  (8)  follows  from  (5)  as 


K 

|“[7  1*1  -  i?Dj(k)  -5\(k)] 
*k=l  ^ 


-1/2 


*  exp 


^  -  l5Ni(k)  -f^N2(k) 

^  1  -  iFDj(k)  - 


(9) 


*  These  means  can  be  interpreted  as  the  deterministic  signal  components  of 
the  channels  s  and  t,  if  desired. 
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where  the  identification  of  Dj(k),  etc.,  is  obvious  from  (6).  Only  one 
(continuous)  square  root  and  one  exponential  per  f  value  is  required  in  (9), 
regardless  of  the  number  of  terms  added,  K.  The  mean  and  variance  of  random 
variable  x  in  (8)  follows  from  (9)  as 

k=l 


ol  =  5  O^lk)  +  2NQ(k)  D^(k)  -  D^Ck)  -  2Nj(k^  .  (10) 

Any  analytical  attempt  at  determining  the  probability  density  function  or 
cumulative  distribution  function  corresponding  to  characteristic  function  (9) 
would  be  a  formidable  task  indeed.  However,  it  is  a  very  simple  task  via  the 
method  of  [1]  to  get  accurate  numerical  values  for  the  cumulative  and 
exceedance  distribution  functions.  The  program  listing  in  appendix  A 
accomplishes  this  task,  based  upon  characteristic  function  (9)  and  the 
constants  listed  in  (6).  All  the  weights  {a|^,  b,^,  C|^,  d,^,  and 
statistical  parameters  o^j^,  Pj^^are  arbitrary.  Observe 

that  (9)  is  far  more  general  than  the  characteristic  function  considered  in 
[3,  eq.  5],  which  itself  required  a  very  lengthy  analytic  treatment  to  get  the 
probability  density  function  and  cumulative  distribution  function.  In  fact, 
there  is  little  hope  of  getting  any  tractable  analytic  results  for  (9)  when  K 
is  greater  than  2. 

Special  Case  1 


Suppose  weightings  a,  b,  c,  d,  e  in  (8)  are  independent  of  k  and  that 
statistics  a^,  p  are  also  independent  of  k.  The  decision  variable  x 
in  (8)  then  simplifies  to 

K 

X  =  2^^^k  ^^k  ‘^^k^k  *  ^^k  *  ®^k^  * 

k=l 
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Then  O2,  N2  are  independent  of  k.  If  we  define  mean  parameters 


sk  ’  02 


m  ,  m. , 
sk  tk 


f\ 

**10  *  5  "sk  ’  ”01  °  2 


the  characteristic  function  of  x  in  (9)  then  takes  the  simpler  form 


f.(y)  =  (1  -  i?0l  -  f  D,)  exp  t? 


where  and  O2  are  still  given  by  (6),  and 


Nq  =  aMjp  ♦  bMgj  »  cMjj  *  +  eHgj  , 


n;  =  (4ab  -  c^)(i  at”20  4'’s%2  -  “Vt'^ll’ 

+  (2ae  -  cd)a^(CT^MQj^  - 

+  (2bd  -  ce)CT^(o^MjQ  -  ' 

-  K  (|  d^Og  +  I  +  deoo^a^) 


N2  =  -  K(ae^  +  bd^  -  cde)(l  -  p^)oIo^ 


I 

(The  choice  of  K  =  2  and  N2  =  0  in  (13)  corresponds  to  the  form  given  in 

[3,  eq.  5].)  Observe  that  the  characteristic  function  in  (13)  (and  therefore 
the  performance)  of  the  processor  in  (11)  depends  on  the  means  s.nd 

I'^tk}  through  the  parameters  defined  in  (12).  The  mean  and  variance 
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of  random  variable  x  in  (11)  follow  from  characteristic  function  (13)  as 


®x  =  1  '^‘^1  ^Vl  ■  *^^2  " 


Special  Case  2 


Let  us  also  assume  d  =  0,  e  =  0  in  (11)  above;  then  the  pertinent 
decision  variable  is  given  by 


I  ^ 

■  2.  (“k  ‘’*k  “k*k) 


Dj^  and  O2  are  still  given  by  (6),  and  there  follows  from  (14), 


Nq  =  aM2Q  +  bMQ2  , 


«;  =  (4ab  -  c^)(|  *  I 


N2  =  0  .  (; 

The  characteristic  function  of  x  is  given  by  (13),  with  =  0.  The  mean 
and  variance  of  x  in  (16)  are  given  by  (15). 

Fading  for  Special  Case  2 

Let  the  mean. parameters  in  (12)  be  subject  to  slow  fading;  i.e., 

replace 

M20  by  rM2Q,  Mq2  by  rMg2.  by  rMj^  (; 


where  power  scale  factor  r  has  probability  density  function 
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Pr(“)  •  p"’*'  for  u  >  0,  V  >  0; 

r  =  I,  i  Xr(n)  - for  n  >  1.  (19) 


This  form  of  fading  is  encountered  in  diversity  combination  receivers;  see, 
for  example,  [4,  eq.  9  et  seq.]  and  [5,  eq.  24  et  seq.].  Then  (13),  (17),  and 
(18)  yield  the  conditional  characteristic  function,  for  a  specified  r,  as 


f^dlr) 


/  2 
^1  -  i?Di 


exp 


ifr 


"o  - 

1  -  iJOj  - 


(20) 


Weighting  (20)  according  to  the  probability  density  function  in  (19),  and 
performing  the  integral,  there  follows,  for  the  characteristic  function  of  the 
decision  variable  x  in  (16),  the  result 


(The  limit  of  (21)  as  v-^+«is  again  (13)  with  N2  =  0,  as  in  (17);  this 
agrees  with  the  fact  that  the  corresponding  limit  of  the  probability  density 
function  in  (19)  is  p^(u)  =  S(u-l).)  The  mean  and  variance  of  x  in  (16) 
follow  from  characteristic  function  (21)  as 


”x  =  No4'<‘>1  - 

=  I  KD^  +  2NqDj  -  KD2  -  +  Nq^/v  .  (22) 

Observe  that  mean  is  independent  of  v,  the  power  law  in  fading  (19).  A 
program  for  the  cumulative  and  exceedance  distribution  functions  corresponding 
to  characteristic  function  (21)  is  given  in  appendix  B. 
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SPECIAL  FORMS  OF  SECOND-ORDER  PROCESSOR  (8) 

Before  embarking  on  the  analysis  of  the  other  two  classes  of  processors, 
we  will  explicitly  detail  some  of  the  special  forms  that  processor  (8)  reduces 
to,  under  particular  selections  of  the  weightings  and  statistical  parameters. 

A  rather  broad  collection  of  typical  processors  will  be  seen  to  be  included. 

In  the  following,  any  unspecified  weights  fa,^,  b,^,  c,^,  d,^.  e,^]  are  zero, 
and  any  unspecified  statistical  parameters  that  do  not  appear  in  the  final 
char 'cteri Stic  function  are  irrelevant. 

I.  Gaussian 


d 


k 


=  1 


X 


s 


k 


II.  Chi-square  of  K  Degrees  of  Freedom 


k=l 


”  (l  - 
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III.  Non-Central  Chi-Square  (Q|yj  Distribution  if  K  =  2M) 


®sk  “  ‘'s 


k«l 


f,{f)  =  (i  - 


2\-K/2 

i'j2a^J  exp 


m 


k=l 


sk 


1  -  if2c 


IV.  Weighted  Energy  Detector 


a^  ^  0,  d|^  ^  0 


IX 

•I 


*  ‘‘k^k* 


k=l 


^  ^'"sk  *  '*k'"sk  * 

_  k.l  1  -  ’F'\”sk  J 

V.  Weighted  Cros.'-Correlator 

Ck  ^  0 

K 

’<  -  2  Vk‘k 
k=l 


D^(k)  =  2c,^Pk‘^sk®tk’ 

DgCk)  =  -c^{l  -  Pk)osk®t^ 
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No(k)  = 


Ni(k)  = 


2,1  2  2 

-^k^?  ^k  ‘^tk 


1  2  2 
?  "’tk'^sk 


"  '^k'"sk”’tk®sk°tk^’ 


N2(k) 


Characteristic  function  f  (f)  is  given  by  (9). 


VI.  Two-Channel  Energy  Detector 


aj^  0,  b|^  ^  0 


IN 

'  ^  *  '’k’-k* 


“l<k)  ”  , 

DjCk)  -  4a^b,(l  -  4), Jo, 2 
No(k)  =  *  b|^n.^^. 


Ni(k)  =.  4a^b^4  .  1 


■  '’k"’sk"’tk®sk®tk^» 


N2(k) 


Characteristic  function  f^{J)  is  given  by  (9).  A  simple  application  of  this 
particular  processor  was  encountered  in  [6,  eqs.  25-26]. 
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VII.  Two-Channel  Energy  Detector  and  Cross-Correlator 


K 

*  ■  5.  ^  ^‘k  ^  'kH‘k' 

k=l 

Dj(k)  .  *  Vtk  *  ‘=k'’k‘’sk'’tk>  > 

D^Ck)  =  (4a^b|,  -  c^)(l  -  , 

"O*'')  -  Vsk  *  Vtk  ^  “"k^sk^tk  ■ 

Ni(k)  =  (4a|^b|^  -  c2)(|  ^  1 

N2(k)  »  0  . 


Characteristic  function  is  given  by  (9). 
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NARROWBAND  CROSS-CORRELATOR 


Figure  1.  Narrowband  Cross-Correlator 

The  processor  of  interest  in  this  section  is  depicted  in  figure  1.  Input 
signals  Sj^(t)  and  S2(t)  are  arbitrary  deterministic  narrowband  real  waveforms: 

Sj(t)  »  Re[sj.(t)  exp{i2ttfQt)j  =  ^.{t)  cos(2irf^t  +  = 

»  aj(t)  cos(2irfQt)  -  bj{t)  sin{2irfQt)  for  j  =  1,2,  (23) 

where  input  signal  complex  envelope 

Sj(t)  =  Aj(t)  exp(iP^.(t))  =  aj(t)  +  ibj(t)  (24) 

in  terms  of  polar  or  rectangular  low-frequency  components,  respectively. 

Input  noises  nj^(t)  and  n2(t)  are  zero-mean  correlated  narrowband 
jointly-Gaussian  processes  which  may  be  nonstationary: 

nj.(t)  =  Re[nj(t)  exp(i2irfQt)j  »  Xj{t)  cos(2iTf^jt)  -  yj(t)  sin(2fffQt),  (25) 
where  noise  complex  envelope 

nj(j;)  =  Xj(t)  +  iyj(t)  for  j  =  1,2.  (26) 

The  statistics  of  the  input  noise  complex  envelopes  are  arbitrary: 
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^  =  2a^  , 


nj^(t)  Jl2(t)  =  2o^a2Y»  where  y  =  p  +  ix  =  jrlexpCi^), 

r|ij(t)  n^(t)  =  0  for  all  j,  m.  (27) 

The  quantities  oj^,  02,  y  can  all  vary  with  time  t,  for  nonstationary  noise 
processes.  There  follows,  for  the  statistics  of  the  in-phase  and  quadrature 
components  defined  in  (25), 


2  2 
Xi  =  yi  ==  ap 

=  0  , 

T  T  2 
^2  “  ^2  *  ®2* 

X2y2  =  0  » 

X1X2  =  = 

X2yi  =  -xiy2 

(28) 

The  reason  for  breaking  out  this  narrowband  cross-correlator  as  a 
separate  problem  is  now  apparent  from  (28)  Namely,  at  each  time  instant,  a 
group  of  four  random  variables  are  statistically  dependent  on  each  other. 

This  case  does  not  fall  into  the  framework  of  (8)  above,  since  only  two  random 
variables  were  dependent  there. 

Using  the  narrowband  character  of  all  the  waveforms  in  (24)  and  (26),  the 
lowpass  filter  output  in  figure  1  may  be  expressed  as 

z(t)  =  |[x^(t)  +  a^(t)][x2(t)  +  a2(t)3  +  ^[y^(t)  +  bj^(t)][y2(t)  +  b2(t)].  (29) 

15 


TR  7035 


The  final  system  output  in  figure  1  is  the  weighted  sum  of  K  terms, 

K 

V  =  ^  w(k)  z(t|^)  ,  (30) 

k=l 

where  it  is  assumed  that  the  time  separations  between  samples  at  instants 
ft|^}  lead  to  statistically  independent  random  variables  [z(t|^)}.  The 
weights  and  statistics  can  change  with  sample  time  tj^,  in  an  arbitrary 
fashion. 

Based  upon  the  method  in  [7],  we  find  the  characteristic  function  of  z(t) 
in  (29)  to  be  given  by 


..  '^0  " 

exp  ^ 


where  the  constants  (in  their  most  compact  form)  are  given  by 


Dj  =  o^o2P  . 

n  1  2  2,1  2  ,2i 

^2  “  4  ^  * 

No  *  +  b^b^)  , 

”  8|^2^^1  ^  ^  *'  ^1^2^  ~  2oja2x(a2bj  -  aj^b2)J. 

(32) 

(The  characteristic  function  and  constants  in  (31)  and  (32)  are  not  to  be 
interchanged  or  confused  with  any  earlier  results  in  previous  sections.  In 
fact,  observe  there  is  no  square  root  involved  in  (31).)  All  of  the 
parameters  in  (32)  can  vary  with  time  t. 


In  terms  of  the  signal  polar  definitions  in  (24)  and  the  complex  noise 
correlation  coefficient  y  in  (27),  alternative  expressions  to  (32)  (where  we 
have  etiphasized  the  t-dependence)  are 
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Oj  =  a^it)  a2(t)  Re[Y(t)}  =  aj^(t)  a^{t)  jY{t)j  COS  ^(t), 

D2  ^^(t)  old)  (i-lY{t)|2)  , 

%=7  Re[s^(t)  S^ltj]  =  \  A^(t)  A2(t)  cos[Pj(t)-P2{t)]  , 

Ni  =|^^(t)|si(t)(2  +  of(t)js^(t}l^  -  2  a^(t)  a^(t)  Refs*(t)  S2(t)  r(t)}]^ 

=  A^(t)  +  a^(t)  ^l{t)  -  2  o^(t)  a^it)  A^(t)  A2{t)  |Y(t)|  cos[Pj{t)-P2(t)-«(t)1 

^  (33) 

The  mean  and  variance  of  z(t)  in  (29)  follow  from  (31)  as 


=  Di  +  Nq  , 


0^  =  +  2D2  +  20j_Nq  +  2N^  . 


(34) 


Finally,  the  characteristic  function  of  the  narrowband  cross-correlator 
output  V  in  (30)  follows  from  (31)  as 


%(f)  -  ■([  = 

k=l 

w(k)  NQ(k)  +  ijw^(k)  N^(k) 
l-i^w(k)  Dj(k)  +  fV(k)  D2(k) 

(35) 

where  we  have  allowed  all  the  parameters  in  (32)  and  (33)  to  vary  with  time 
t|^.  The  mean  and  variance  of  output  v  follow  from  (35)  as 

K 

Uy  =  2  [D^(k)  +  Nglk)], 

k=l 

%  “  2  ^  2D^(k)NQ(k)  +  2N^(k)7. 

k*! 


(36) 
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A  program  for  the  evaluation  of  the  cumulative  and  exceedance  distribution 
functions  via  (35)  is  given  in  appendix  C. 

and 

In  comparison  with  earlier  results  inj^[7],  we  have  obtained  the  following 
extensions  here: 

1.  The  input  signals  are  arbitrary  narrowband  waveforms;  they  are  not 
limited  to  two  sine  waves  at  the  same  frequency; 

2.  The  Gaussian  input  noises  can  be  nonstationary; 

3.  The  number  of  terms  summed  to  yield  the  narrowband  cross-correlator 
output  can  be  greater  than  1; 

4.  The  characteristic  function  is  in  its  most  compact  form,  and  the 
constants  are  expressed  directly  in  terms  of  given  quantities, 
having  eliminated  all  auxiliary  variables. 

Output  Signal-to-Noise  Ratio 

It  is  sometimes  desirable  to  have  simple  expressions  for  the  output 
signal-to-noise  ratio  of  the  narrowband  cross-correlator  in  figure  1.  In 
terms  of  the  lowpass  filter  output  z(t),  we  observe  first  from  (32)-{34)  that 

u^{s)  =  U2(s+n)  -  U2(n)  =  Nq  =  I  Aj  A2  cos(PpP2)  .  (37) 

We  then  have  two  alternative  definitions  of  the  signal-to-noise  ratio  at  the 
lowpass  filter  output: 


R2(n) 


u^(s)  A?  A?  cos^(P,-Pp) 

TTT  "  2  Z.  2  2.  ’ 

a2(n)  2  02(l+p  -X  ) 


^^(s+n) 


u^(s)  Aj  A2  cos^(Pj-P2) 

o^(s+n)  4(Dj  +  2O2  +  2D^Nq  +  2H^)  * 


(38) 
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These  closed  form  expressions  allow  for  arbitrary  noise  correlations  and  are 
considerably  simpler  than  [7,  eqs.  41-43].  The  signal-to-noise  ratios  of 
system  output  v  in  figure  1  are  K  times  greater  than  either  form  in  (38). 

Specialization  to  Narrowband  Energy  Detector 

If  the  signal  and  noise  parameters  in  (24)  and  (27)  are  chosen  as 

aj^(t)  =  a2(t)  =  a(t)  , 

bj(t)  =  b2(t)  =  b(t)  , 

a^(t)  =  02(t)  =  a(t)  , 

p(t)  =  1,  X(t)  =  0  ,  (39) 

then  figure  1  reduces  to  identical  input  channels,  that  is,  a  narrowband 
energy  detector.  There  follows  from  (32), 


Dl  =  a^(t),  02  =  0  , 

Nq  =  +  b^(t))  =  ^  A^(t),  =  0  ,  (40) 


and  (31)  becomes 


f,(?,t)  = 


exp 


1  -  iK(t)  I  1  -  i^"(t)J 


i! 


A^(t)/2 


(41) 


Corresponding  results  for  the  system  output  v  are  easily  obtained  from  this. 
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REDUCTION  OF  HERMITIAN  AND  LINEAR  FORM 

The  most  general  case  of  interest  in  this  section  is  as  follows: 
random  complex  matrix 


X  -  [Xj^  X2  ...  Xj^] 


is  Mxl;  constant  complex  matrix 


A  *  [a,  a^  ...  a„] 


is  Mxl;  and  constant  complex  matrix 


hi  ••*  ^IM 


^M1  •••  ^MM 


is  MxM  and  Hermitian.  The  Hermitian  and  linear  form  we  consider  is 

q  =  X^BX  +  |(X^A+A^X)  = 

M  M 

m  nm  n  Z  mm  mm 

m,n=l  m«l 

which  is  real.  Random  variable  q  is  a  weighted  sum  of  all  possible  products 
of  [x*|  and  {x^|,  plus  linear  combinations.  A  and  B  are  called  the 
weighting  matrices. 


*  For  M=2  or  4,  and  real  variables  and  weights,  (45)  reduces  to  the  earlier 
forms  given  in  (1)  and  (29). 
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We  will  concentrate  in  this  section  on  reducing  form  (45)  to  a  weighted 
sum  of  squares  of  uncorrelated  random  variables.  This  stepping  stone  does  not 
require  any  Gaussian  assumptions  on  X  and  is  therefore  useful  as  a  separate 
item. 


The  relevant  statistics  pertaining  to  random  vector  X  are 


X  =  E  (mean  matrix) , 

X  =  X-  X  =  X-E, 

Cov[x}  =  XX^  =  K  (covariance  matrix),  (46) 

where  statistics  matrices  E  and  K  are  given.  MxM  matrix  K  is  always  Hermitian 
and  non-negative  definite.  We  assume  K  is  positive  definite;  otherwise 
eliminate  the  linearly  dependent  components  of  X.  We  allow  x^  and  x^  to 
be  correlated  with  each  other  for  any  m  and  n;  this  situation  is  much  more 
general  than  the  investigations  above. 

Let  C  be  a  constant  MxM  matrix  and  form  the  linearly  transformed  variables 

W  =  C^X  =  [w^  W2  ...  w„]^.  (47) 

Then  the  statistics  of  W  are  given  by 

W  =  C^E, 


w  =  w  -  w  =  c"x. 


Cov[w3  =  WW^  =  =  CHkc. 

Also,  from  (47) ,  since 


{4S) 


X  =  C~^W, 


(49) 
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then  we  can  express  (45)  as 

q  =  W^C“^C~\  +  ^{W^D  +  d'S^), 

where  we  define  constant  Mxl  matrix 

D  =  C  =  [dj  d2  ...  d^]  . 

We  want  to  have,  from  (48)  and  (50), 

C^KC  =  I 


(50) 


(51) 


(52) 


and 


*j\.=  diag(x^  ...  x^);  i.e.  =X^  , 

for  then,  in  addition  to  the  relation  between  the  means, 

W  =  A, 


(53) 


(54) 


we  have  the  desirable  properties 


Cov{w]  =  I, 


(55) 


and 


M  M 

-  =  W^XW  +  ^(w'^D  +  D^W)  =  2  A„)w„|^  +  Re  dV  .  (56) 

2  ml  ml  mm 

iTi=l  nfi=l 

That  is,  the  random  vector  W  given  by  (47)  is  composed  of  uncorrelated  unit- 
variance  components,  and  q  is  a  weighted  sum  of  magnitude-squares  of  these 
components,  in  addition  to  a  linear  sum. 

We  now  have  to  address  the  problem  of  determining  the  MxM  matrices  C  and 
Jiin  (52)  and  (53).  From  [8,  p.  106,  Theorem  2],  we  identify 
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M-^K,  (57) 

then  according  to  [8,  p.  107,  eq.  29],  we  must  solve  for  C  and  A  in  the 
equation 


B-h  »  KCA“^.  i.e.  BKC  =  CA.  (58) 

So  the  only  matrix  that  need  be  considered  is  the  MxM  product  BK.  C  is  the 
modal  matrix,  and  A  the  eigenvalue  matrix,  of  BK.  Also,  from  (51), 

D  =  C^A,  since  C"^  =  C^.  (59) 

Letting  C  «  ...  where  eigenvector  is  a  Mxl 

matrix,  (58)  can  be  expressed  as 

^  1  1  (60) 

Several  important  properties  hold  for  A  and  C: 

The  are  all  real,  but  can  be  positive,  zero,  or  negative. 

If  K  and  B  are  real,  then  C  is  real.  (61) 

If  B  is  positive  definite,  then  >  o  for  1  <  m  <  M. 

If  A  =  0  and  E  =  0,  there  is  no  need  to  solve  (58)  for  C, 
because  D  =  0  and  W  =  0. 
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QUADRATIC  AND  LINEAR  FORM 


If  random  vector  X  is  real  Gaussian,  if  A  is  real,  and  if  B  is  real 
symmetric,  then  mean  E  and  covariance  K  are  real,  and  it  follows  that  modal 
matrix  C  is  also  real.  Also  from  (47)  and  (59),  W  and  D  are  real.  Equation 
(45)  reduces  to 


q  =  X^BX  +  X^A  = 


^m^mn^n  *  ^m^m  * 


m,n=l 


which  is  a  quadratic  form  and  linear  form. 


Letting  mean  W  in  (54)  be  expressed  as 

W  =  [vj^  ^2  ... 

the  Gaussian  character  of  X  and  the  linear  transformation  (47)  allow  us  to 
write  the  probability  density  function  of  W  as  a  product: 

P(W)  =  jr  {(2it)-^'^  exp^^  (w^  -  v^)2)j.  (64) 

Here  we  used  property  (55).  Since  we  now  have,  from  (56), 

M 

m=i 

the  characteristic  function  of  q  is 
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where  the  square  root  must  be  a  continuous  function  off,  not  a  principal 
value  square  root.*  Notice  that  only  one  square  root  and  one  exponential  is 
required  per  f  value.  Observe  that  the  characteristic  function  depends  on  the 

separate  values  merely  on  their  sums.  If  A  =  E  =  0,  the 

exponential  is  unity,  by  virtue  of  (54)  and  (59).  And  if  M=2,  (66)  reduces  to 
(5),  while  M=4  leads  to  form  (31). 

To  sunsnarize,  the  characteristic  function  ^^(f)  in  (66)  for  random 
variable  q  in  (62)  requires  the  constants  {x^},  [d^"^,  and  for  1  <  m  <  M. 
The  initially  given  quantities  are  weighting  matrices  A,  B  and  statistics 
matrices  E,  K.  We  first  solve  the  equation  (58), 

BKC  =  CA,  (67) 

for  eigenvalue  matrix  JL  and  modal  matrix  C  corresponding  to  BK.  Then 
=  diag(x^  X2  ^[^)  , 

D  =  C^A  =  [d^  d2  ...  dj^]  , 

IT  =  =  [vj  V2  ...  .  (68) 

If  the  mean  of  input  X  is  zero,  E  =  0,  and  if  the  linear  weighting  form  is 
zero,  A  =  0,  then  there  is  no  need  to  solve  for  modal  matrix  C  of  BK  in 

(67).  Then  D  =  W  =  0  and  the  exponential  term  in  (66)  is  unity.  One  only 
need  compute  eigenvalue  matrix  A  of  BK  in  this  case. 

A  program  for  the  evaluation  of  the  cumulative  and  exceedance 
distribution  functions  corresponding  to  characteristic  function  (66)  is  listed 
in  appendix  D.  The  inputs  to  the  program  are  considered  to  be  M, 


*  That  is,  the  square  root  is  the  analytic  continuation  of  the  function 
defined  as  1  at  f  =*0. 
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that  is,  it  is  presumed  that  (67)  and  (68)  have  already  been 
solved  prior  to  use  of  the  program. 


The  cumulants  of  q  are  obtained  from  (66)  as 


In  particular,  the  variance  of  q  is 


X<,(2) 


(69) 


(70) 


If  another  random  variable  is  formed  by  the  sum  of  several  independent 
random  variables  q^  with  the  form  (62),  but  with  different  sizes  Mj,  the 
new  characteristic  function  is  the  product  of  terms  like  (66). 


Breakdown  of  X  into  Two  Components 

It  is  useful  to  investigate  a  particular  version  of  the  general  results 
above,  because  the  resultant  forms  correspond  to  some  often-realized  practical 
energy  detectors  and  correlators.  We  let  M  =  2N,  and 


ful 

\  \ 

'b‘1  b‘2' 

'a*!'' 

X  = 

- 1 

> 

_ 1 

«• 

GO 

II 

b21  b2^ 

• 

II 

< 

,(2) 

where  U,  V,  are  Nxl  real  matrices,  and  are  NxN  real 

matrices.  Also  B^^  and  B^^  are  symmetric,  while  B^^  =  B^^  .  Then 
(62)  can  be  expressed  as 
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.  .  X^A  =  [u^  vf]  r;  = 

_  J  L  J  L 

=  uV^U  +  +  V^B^^V  +  = 

»  U^B'^^U  +  2U^B^^V  +  V^B^^V  +  U^A^^^  +  V^A^^^  = 

=  5  /u  u  +  2u  V  +  V  b^^  v  \  +  ^  /u  +  v 

^  rm  mn  n  m  mn  n  m  mn  n)  ^1.1  n  n  n  n  / 

m,n=l  ^  ^  n=l  ^ 

=  all  possible  auto  and  cross  combinations  of  random 

variables  {up|*'^  and  {V||^  »  P^us  linear  combinations.  {72) 


We  also  have,  from  (47)  and  (68), 


’'=4:VE 


D  =  C' 


.(2)  ’ 


K  .  Cov{xl  .  =  |1  R  V^l  =  R  R 

I*  J  ^  '^yv 


Then  the  fundamental  matrix  required  in  (67)  is  expressable  as 


BK  » 


b11  bI^  ^u  "uv 


K  K 
vu  vv 


which  is  a  2Nx2N  matrix.  Also  random  variable  (65)  is  now 


P*  /  2  N 
5,(Vni  Vm) 

mal  ' 
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which  has  2N  terms.  The  characteristic  function  of  q,  in  general,  follows 
from  (66)  and  (68)  as 


-1/2 


*  ^  Tnni  iifn  /  ~tc\ 

- l-i5x„r -  ’ 

r  m> 


where 


W  =  [v,  ...  V2^]^  "  Ey  ’  D  =  [dj  ...  d2^]^  -  ^2)  .  i 

L  vj  [A  J 

(If  =  Ey  =  =  0,  then  D  =  0  and  W  =  0,  and  there  is  no 

need  to  solve  for  modal  matrix  C;  the  exponential  in  fq(f)  in  (76)  is  then 
unity. ) 


As  a  special  case,  if  A  =  0,  =  0,  =  0,  then  (71)  and  (73) 


yield 


-O  b12' 

“  0  J  * 


D  =  0  , 


and  (72)  gives 


q  =  2U^B^^V  =  2  S  u_  v 
m,n=l 


=  all  possible  cross  combinations  of  and 


Then  (74)  specializes  to 

r.  nl2l 


0 


0  J|^u  ^v 


vu  vv 

B^^K  ,  B^^K 
uu  uv 
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and  (75)  reduces  to 


X 

m  m 


with  characteristic  function 


f,(?)  -  IT  -  '^‘4 

lm=l 


-1/2 


2N  X  y" 
^  mm 


.  ,a  ^  111  ni 

"'‘P  1  -I2x-t 

m=l 


following  directly  from  (76)  and  (78). 

For  the  particular  example  of 

B  «  diag(Xj^  j^2  *  *  *  ^  ^2  ’  *  *  ^2  *  *  *  (82) 


with  the  same  characteristic  function  (82). 

12  1 

As  a  still  more-special  case,  let  B  ="2 
simple  cross-correlator  (but  with  correlated  inputs  for  all  time  separations) 

N  2N  „ 

q  =  ^  u_v  =  X  w^  ,  (85) 

^  ^  n  n  mm  '  ' 

n=l  m=l 

and  (80)  and  (77)  become 

Ipvu  ^v1  _  A1 

BK  =  I  ,  W  =  C'  =  [v^  ...  V2p^]'  .  (86) 

"^uu  ‘^uv 
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The  important  equations  that  must  be  solved  are  always 

BKC  =  CA  (87) 

or 

for  1  <  m  <  M  =  2N,  (88) 

where  all  matrices  B,  K,  C,  j\.  are  2Nx2N.  The  characteristic  function  of 
(85)  is  again  (82). 


Here  we  let  components  U  and  V  have  the  same  covariance  and  a  scaled 
cross-correlation;  that  is,  let 


where  p  is  a  scale  factor.  This  case  corresponds,  for  example,  to  a  common 
signal  in  two  independent  components: 


u(t)  =  s(t)  +  nj(t), 
v(t)  =  s(t)  +  n2{t). 


(90) 


where  s(t),  nj(t),  n2(t)  are  all  independent  and  have  a  common  covariance. 
Then  (8u)  becomes 


Now  suppose  that  we  can  determine  the  NxN  eigenvalue  matrix  P  and  modal 
matrix  Q  of  K^,  that  is 
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“  QT  ;  r*  diag(Yi.  Y2  ••• 
Then  we  have  the  standard  relations  [8] 

Kjj  =  QTQ^  where  QQ^  =  I. 

We  can  now  express  the  2Nx2N  matrix  in  (91)  as 


and  2Nx2N  identity  matrix 


I—  -if  "Y r*  T  T 

Q  0  I  0  q'  0 

^2N  “  T  ’ 

0  Q  0  I  0  Q* 

There  follows 


(92) 


(93) 


(94) 


(95) 


oir^pp-xi  "IIq^  0 


^  II 7  ^  r  “  ^  I  j[0 


(96) 


But  the  middle  matrix  in  (96)  can  be  developed  in  detail  in  the  partitioned 
form 
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This  matrix  is  singular  when  the  kUi  row  is  equal  to,  or  the  negative  of,  the 
k+N  ^  row.  This  leads  to  the  eigenvalues  of  matrix  BK: 

—  ■2( p‘*'1)yj^»  Xjj  =  , 


=  •••>  X211J  = 


Thus  we  need  only  solve  for  the  N  eigenvalues  jYp^J  of  matrik  K^,  and 
then  use  them  as  above  to  determine  all  2N  eigenvalues  of  BK;  this  is  a 
significant  shortcut. 


If  also  Ey  =  Ey  =  0,  then  W  =  0  from  (86),  and  the  characteristic 

function  of  q  in  (85)  follows  from  (82)  and  (98)  as 

'N  -1-1/2 

fq(F)  =  TT  {(l-1(on)r^f)(l-1(„-l)r„f)} 
jn=l  _ 


|l-i2p,J  ^ 


-1/2 


(99) 


This  is  a  generalization  of  [1,  eq.  54],  which  held  for  a  single  pair  of 
Gaussian  random  variables. 
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EXAMPLES 

The  program  listed  in  appendix  A  for  the  second-order  processor  (8)  and 
attendant  characteristic  function  (9)  has  been  employed  to  yield  the  result  in 
figure  2.  The  particular  values  for  the  number  of  terms  K,  the  weights,  and 
the  input  statistics  are  listed  in  lines  20-120.  There  is  no  physical 
significance  attached  to  this  particular  example;  rather  it  has  been  run 
simply  to  illustrate  the  extreme  generality  that  the  technique  is  capable  of. 
Some  negative  values  for  the  weights,  means,  and  correlation  coefficients  have 
been  employed  tc  emphasize  this  generality.  This  simple  example  (and  others 
to  follow)  can  be  used  as  a  check  case  on  any  user-written  program  to  evaluate 
cumulative  and  exceedance  distribution  functions. 

The  selection  of  parameters  L,  &,  b  in  lines  130-150  is  discussed  in 
detail  in  [1];  the  reader  is  referred  there  for  the  deleterious  effects  that 
can  occur  for  improper  choices  of  L,  &,  b.  The  selection  of  the  FFT 
size  in  line  160,  is  rather  arbitrary;  it  controls  the  spacing  at  which  the 
probability  distributions  are  computed,  but  has  no  effect  upon  the  accuracy  of 
the  results  (except  for  round-off  noise).  Additional  computational  details  on 
the  particular  program  for  characteristic  function  (9)  are  given  in  appendix  A. 

The  ordinate  scale  for  figure  2  is  a  logarithmic  one.  The  lower  right 
end  of  the  exceedance  distribution  function  curve  decreases  smoothly  to  the 
region  lE-11,  where  roundoff  noise  is  encountered.  The  exceedance 
distribution  function  values  continue  to  decrease  with  x  until,  finally, 
negative  values  (due  to  roundoff  noise)  are  generated.  For  negative 
probability  values,  the  logarithm  of  the  absolute  value  is  plotted,  but 
mirrored  below  the  lE-12  level.  These  values  have  no  physical  significance, 
of  course;  they  are  plotted  to  illustrate  the  level  of  accuracy  attainable  by 
this  procedure  with  appropriate  choices  of  L  and  a. 

The  rates  of  decay  of  the  cumulative  and  exceedance  distribution 
functions  in  figure  2  are  markedly  different  for  this  particular  example. 
Additionally,  since  the  decays  are  both  linear  on  this  logarithmic  ordinate, 
it  means  that  both  tail  distributions  are  exponential,  not  Gaussian.  These 
attributes  of  the  cumulative  and  exceedance  distribution  functions  are  easily 
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and  quickly  discernible  by  use  of  the  numerical  technique  in  [1],  for  a 
limitless  variety  of  weights  and  input  statistics,  with  a  minimum  of  effort  on 
the  part  of  the  user. 

As  a  check  on  the  program  in  appendix  A,  the  second-order  processor  in 
(8)  was  simulated,  and  10,000  independent  trials  were  used  to  determine  its 
performance  for  the  exact  same  parameters  as  used  for  figure  2  above.  The 
program  is  listed  in  appendix  E  and  the  results  are  given  in  figure  3.  The 
corroboration  is  excellent,  even  near  the  lE-4  probability  level. 

As  the  number  of  terms,  K,  in  the  second-order  processor  (8)  is 
increased,  and  if  the  statistics  are  identical,  the  random  variable  x  should 
approach  Gaussian,  at  least  near  its  mean.  The  example  in  figure  4  was  run 
for  K  =  10,  and  all  weights  and  statistics  independent  of  k;  the  particular 
choices  were 

a  ^  d  —  —.6,  c  d  —  —.2,  e  —  *^9 

fOg  =s  .5,  m^  =  -*5,  Og  *  1,  =  1,  p  =  .4,  (100) 

L  =  4,  a  =  .05,  b  =  20Tr,  =  256. 

The  cumulative  and  exceedance  distribution  functions  in  figure  4  both  display 
a  parabolic  shape  near  the  mean  of  x,  which  signifies  Gaussian  behavior  of  the 
random  variable,  as  expected.  However,  on  the  tails,  the  distributions  are 
tending  to  linear,  which  means  an  exponential  decay  there.  This  observation 
for  this  example  confirms  the  comments  of  [7,  p.  673]. 

The  cumulative  and  exceedance  distribution  functions  for  an  example  of 
the  second-order  processor  with  fading  are  displayed  in  figure  5,  as 
determined  from  characteristic  function  (21)  and  the  corresponding  program  in 
appendix  B.  The  power  law,  v,  for  the  fading  probability  density  function 
(19)  is  2.7  for  this  example,  but  can  be  easily  changed.  The  particular 
constants  employed  are  listed  in  lines  20-110  in  appendix  B. 

An  example  of  the  distributions  for  the  narrowband  cross-correlator  of 
figure  1  is  presented  in  figure  6,  as  evaluated  from  characteristic  function 
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Figure  4.  Second-Order  Processor,  K^IO,  Identical  Statistics 
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Figure  5.  Second-Order  Processor  with  Fading 
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and  the  program  in  appendix  C.  The  weightings,  signal  components,  and 
noise  statistics  have  no  special  values  or  interrelationships;  the  particular 
values  used  here  are  listed  in  lines  20-110. 

The  distributions  for  the  reduced  quadratic  and  linear  form  (65)  and 
accompanying  characteristic  function  (66)  are  presented  in  figure  7  for  the 
numerical  example  employed  in  the  program  listing  in  appendix  D.  If  the  given 
form  is  instead  that  of  (62),  then  (67)-(68)  must  first  be  solved  before  the 
program  in  appendix  D  can  be  employed;  that  is,  one  must  augment  these  results 
with  the  capability  for  extracting  the  eigenvalues  (and  eigenvectors  in  some 
cases)  of  the  MxM  matrix  BK.  The  size  of  the  FFT,  has  been  increased  to 
1024  in  figure  7;  this  results  in  finer  spacing  of  the  distribution  values  and 
additional  spikes  in  the  round-off  noise  region  centered  about  lE-12. 
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SUMMARY  AND  DISCUSSION 

Closed  form  expressions  for  the  characteristic  functions  of  the  decision 
variables  of  three  classes  of  second-order  processors  have  been  derived.  The 
input  noise  to  the  processors  must  be  Gaussian,  but  it  can  be  nonstationary 
with  arbitrary  statistics.  Programs  for  the  direct  evaluation  of  the  exact 
cumulative  and  exceedance  distribution  functions  have  been  generated  and  then 
exercised  for  completely  general  values  of  the  weights,  signal  parameters,  and 
noise  statistics.  There  is  no  assumption  needed  about  a  large  number  of 
statistically  independent  contributors,  nor  need  any  signal-to-noise  ratio  be 
either  small  or  large.  The  first  two  classes  of  processors  are  restricted  in 
form,  but  include  many  of  the  practical  devices  often  encountered  in  detection 
and  estimation  problems.  The  third  class  covers  the  most  general  second-order 
processor;  it  requires  the  solution  for  the  eigenvalue  and  modal  matrices  of 
an  MxM  matrix  (where  M  is  the  size  of  the  general  quadratic  form)  in  addition 
to  the  program  furnished  here.  The  approach  utilized  here  allows  a  user  to 
quickly  and  easily  obtain  accurate  quantitative  information  about  the 
performance  of  a  particular  processor,  and  to  investigate  the  effects  of 
making  changes  in  any  of  the  input  constants  or  parameters. 

Approximations  to  the  performance  of  continuous  quadratic  processors  are 
possible  by  use  of  the  above  procedures.  For  example. 


dt2  x(tj^)  0(t^,  ^2^  ^(^2^  “  ^2  ^ ( ma^ )  a(m&|^,  nA2)  x(nA2)»  (10  ) 


m,n 


which  is  of  the  form  X^BX  encountered  in  (62).  Also 

JJdt^  dt2  u(t^)  a(tp  tg)  v(t2)  a  A2  ^u(mAj)  B{mAj,  nA2)  v(nA2),  (101) 


m,n 


.T„12 


which  is  of  the  form  U  B  V  encountered  in  (79). 
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Receiver  operating  characteristics,  that  is,  detection  probability  vs 
false  alarm  probability,  can  be  easily  determined  from  the  above  results. 
First  store  the  exceedance  distribution  for  zero  signal  strength  in  an  array. 
Then  plot  the  exceedance  distributions  for  nonzero  signal  strengths  vs  this 
stored  array  of  numbers,  each  point  for  a  common  threshold.  The  common 
thresholds  are  most  easily  realized  by  keeping  sampling  increment  t  and  FFT 
size  the  same  throughout  all  the  computations. 
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APPENDIX  A.  SECOND-ORDER  PROCESSOR 


This  program  computes  the  cumulative  and  exceedance  distribution 
functions  of  random  variable  (8)  via  characteristic  function  (9).  The 
required  inputs  are  listed  in  lines  20-120  and  are  annotated  consistently 
with  (8).  The  parameters  Dj^,  D2,  Nq,  N2  required  in  characteristic 
function  (9)  are  pre-computed  once  in  loop  290-510  for  the  sake  of  execution 
time.  The  mean  of  x  is  entered  in  line  520.  When  we  enter  loop  590-830  for 
the  actual  calculation  of  the  characteristic  function  (9),  the  number  of 
computations  are  minimized.  For  example,  only  one  complex  exponential  and 
square  root  are  required  per  f  value,  in  lines  740-750.  The  square  root  in 
(9)  is  not  a  principal  value  square  root,  but  in  fact  must  yield  a  continuous 
function  inj.  In  order  to  achieve  this,  the  argument  of  the  square  root  is 
traced  continuously  from  f =  0  (line  530).  If  an  abrupt  change  in  phase  is 
detected,  a  polarity  indicator  takes  note  of  this  fact  (line  780)  and  corrects 
the  final  values  of  characteristic  function  fy(f)  (line  790).  More  detail 
on  the  selection  of  L,  &,  b  in  lines  130-150  is  available  in  [1], 


18  ! 

SECOND 

-ORDER  PROCESSOR 

28 

K=*5 

!  Number  of  terms  summed 

38 

DflTfi 

!  a<k)  weightings 

48 

DATA 

!  b<k)  weightings 

58 

DATA 

1,1.2, 1.4 

!  c<k)  weightings 

68 

DATA 

.  l,-.2,“.3,  .4,  .5 

!  d<k)  weightings 

70 

DATA 

■"•7,  .8,  .5,  .4,  “.3 

!  e<k)  weightings 

88 

DATA 

.2,  .3,  •4,"'.5,”.6 

!  Means  of  random  variables  s(k) 

98 

DATA 

■  .5,  .4 

!  Means  of  random  variables  t<k) 

188 

DATA 

. 1« .3, .5, • ^  f  .3 

!  Standard  deviations  of  s(k) 

110 

DATA 

■  2, .4*  "^9 1 

!  Standard  deviations  of  t<k) 

120 

DATA 

•  4,~.5,a8,  .7, ““.8 

1  Correlation  coeffs.  of  s<k) 

and  t<k) 

130 

L’25 

!  Limit  on  integral  of  char. 

funct i on 

140 

Delta 

=  .05 

!  Sampling  increment  on  char. 

f unc  t i on 

150 

Bs=.  75*<2*PI/DeUa) 

!  Shift  b,  as  fraction  of  alias  interval 

160 

Mf*2'' 

8 

!  Size  of  FFT 

170 

PRINTER  IS  0 

180 

PRINT 

"L  »";L,  "DeUa  » 

'•;DeUa,  “b  »";Bs,''Mf  =";Mf 

190 

REDIM 

a<i;k),b<i:k),c<i:k),d<i:k),e<i;k) 

200 

REDIM 

Ms<ljK),Mt<l:K), 

Ss<l;K),St<l:K),Rho<l:K) 

210 

REDIM 

D1<1:K),D2<1:K), 

N0<i;k),ni<i.‘K),n2<i:k> 

220 

REDIM 

x<0:Mf-i),Y<0:Mf 

-1) 

230 

DIM  A<l:l0),B<i:i0),C<i:i0>,D<l:l0>,E<i:l0) 

240 

DIM  Ms<l:  10>,Mt<i:  10), 

Ss<l : 10),st( 1: 10),Rho< 1: 10) 

250 

DIM  Dl<l: 10),D2<1; 10), 

N0<l: 10),N1<1: 10),N2<i: 10) 

260 

DIM  X<0; 1023), Y<0: 1023) 

270 

READ 

A<*),B<*),C<^  ,D<*),EC»)  !  Enter 

280 

READ 

Ms<*) , Mt  <*) , Ss<*) 

, St (♦) , Rho<*)  1  constants 
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Cal  cu1  at  i  on 
of 

paramatars 


290 

300 

310 

320 

330 

340 

350 

360 

370 

380 

390 

400 

410 

420 

430 

440 

450 

460 

470 

480 

490 

500 

513 

520 

530 

540 

550 

560 

570 

580 

590 

600 

610 

620 

630 

640 

650 

660 

670 

680 

690 

700 

710 

720 

730 

740 

750 

760 

770 

780 

790 

800 

810 

820 

830 

840 


FOR  J«1  TO  K 

Tl«Ms<J)''2 

T2-Mt<J)''2 

T3«Ss<J)^2 

T4»St<J)-2 

T5«Mt<J)*Mt<J) 

T6«Rho< J)*Ss< J>*St  < J) 

T7»4*fl<  J)*B<J>-C<J)''2 
T8«<  l-Rho<  J>''2)*T3«T4 
T9«Mt<J)*Ss<J) 

T10-Ms<J)*St<J) 

T11»D<J)''2 

T12-E<J)^2 

T13-D<J)*E<J> 

Dl<J>«2*<fl<J)*T3+B<J)*T4+C<J>*T6> 

D2<J)-T7#T8 

N0< J>«fl<J)*Tl+B<J)aT2+C<J)*T5+D<J> 
T-T7*<.5*<T1*T4+T2*T3)-T5*T6) 
T»T+<2*fl<J)*E<J>-C<J)*D<J))*Ss<J>* 
T»T+<2*B< J)*D< J)-C< J)*E< J) >*St < J)* 
N1<J)«T-.5*<T11*T3+T12*T4)-T13*T6 
N2<J)  — <fl<  J>*T12+B<J>*T11-C<J>*T 
NEXT  J 

Mux«SUM<N0)+. 5*SUM<D1 ) 

R-0 
P-1 

Muy-Mux+B» 

X<0)«0 

Y<0)-.5*DaUa*Muy 
N-INT<L/DaUa> 

FOR  Ns-1  TO  N 
Xi -Bal ta*Nt 
X2»Xi*Xi 
Pr«l 

Pi-Sr-Si»0 
FOR  J»1  TO  K 
Dr-1-X2*D2(J> 

Di— X1*D1<J> 

CALL  l1uUPr,Pi  ,Dr,Di  ,A,B) 

Pr-fl 
Pi-B 

CALL  D1v<N0<J)-X2*N2<J),-Xi*Nl<J 
Sr-Sr+A 
Si-Si+B 
NEXT  J 

CALL  Exp<-Xi*S1 ,Xi*<Sr+B*),A,B) 
CALL  SqrCPr.Pi ,C,D) 

Ro-R 

R-ATNCD/C) 

IF  ABS<R-Ro)>1.6  THEN  P— P 
CALL  Di y <A, B| C*P, D»P, Fyr, Fy 1 > 

Hs-Ns  MOD  Mf 
X<M*>-X<M*)+Fyr/'N» 

Y<M»>-Y<M»>+Fyi /N» 

NEXT  Ns 

CALL  Fftl0z<Mf ,X<#),Y<«>) 


*Ms<J)+E< J)«Mt  < J) 

(T9-Rho<:  J)*T10) 
<T10-Rho<J)*T9) 

)*T8 

!  Maan  of  random  variable  x 
!  Argumant  of  square  root 
!  Polarity  indicator 


Argument  xi  of  char,  fn. 
Cal  cul  at  i  on 
of 

character i st i c 
f unc  t i on 
fy<xi  > 


, Dr, Di , A, B> 


!  Coll apsi ng 


!  0  subscript  FFT 
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850  PLOTTER  IS  "GRAPHICS" 

860  GRAPHICS 

870  SCALE  0,Mf,-14,0 

880  LINE  TYPE  3 

890  GRID  Mf/'8,  1 

900  PENUP 

910  LINE  TYPE  1 

920  B*Bs*Mf*Del  ta/'<2*PI )  ?  Origin  for  random  wariabla  x 

930  MOVE  B,0 

940  DRAW  B,-14 

950  PENUP 

960  FOR  Ks»0  TO  Mf-1 

970  T=Y<Ks)-^PI-Ks/Mf 

980  X<Ks)».5-T  !  Cumulative  probability  in  X<*> 

990  Y<Ks)=Pr». 5+T  ?  Exceedance  probability  in  Y<*) 

1000  IF  Pr>=lE-12  THEN  Y=LGT<Pr> 

1010  IF  Pr<*-1E-12  THEN  Y=-24-LGT<-Pr) 

1020  IF  ABS<Pr><lE-12  THEN  Y—12 

1030  PLOT  K»,Y 
1040  NEXT  Ks 
1050  PENUP 

1060  PRINT  Y(0>; Y<l>;Y<Mf-2>;Y<Mf-l> 

1070  FOR  Ks*0  TO  Mf“l 
1080  PrsXCKs) 

1090  IF  Pr>»lE-12  THEN  Y»LGT<Pr> 

1100  IF  Pr<*-1E-12  THEN  Y»-24-LGT< -Pr ) 

1110  IF  ABS<Pr.)<lE-12  THEN  Y*-12 

■1120  PLOT  K»,y' 

1130  NEXT  Ks 
1140  PENUP 
1150  PAUSE 
1160  DUMP  GRAPHICS 
1170  PRINT  LIN<5) 

1180  PRINTER  IS  16 
1190  END 
1200  ! 

1210  SUB  Mul<Xl,Yl,X2,Y2,A,B)  !  Z1*Z2 

1220  A»X1*X2-Y1*Y2 

1230  B*X1*Y2+X2*Y1 

1240  SUBEND 

1250  ! 

1260  SUB  Di  v<Xl,  Y1,X2,Y2,  A,B)  !  Z1/'Z2 

1270  T»X2*X2-*-Y2*Y2 

1280  A*<XUX2+Y1*Y2)/T 

1290  B»<Y1*X2-X1*Y2)/T 

1300  SUBEND 

1310  ! 

1320  SUB  Exp<X,Y,A,B)  !  EXP<Z) 

1330  T-EXP<X) 

1340  A»T*C0S<Y) 

1350  B»T*SIN<Y> 

1360  SUBEND 
1370  ! 
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1380  SUB  Sqr<X,Y,fl,B)  !  PRINCIPAL  SQR<2) 

1390  IF  XO0  THEN  1430 
1400  A»B«SQR<.5*ABS(Y)) 

1410  IF  Y<0  THEN  B«-B 

1420  GOTO  1540 

1430  F»SQR<SQR<X*X+Y*Y)) 

1440  T».5*ATN<Y/'X) 

1450  A«F*COS<T) 

1460  B»F*SIN<T) 

1470  IF  X>0  THEN  1540 
1480  T»R 
1490  A— B 
1500  B»T 

1510  IF  Y>-0  THEN  1540 

1520  A— A 

1530  B— B 

1540  SUBENB 

1550  ! 

1560  SUB  Fftl0z<N,X<*>,Y<*))  !  N  <*  2^10  ■  1024,  N»2''INTEGER  0  subscript 

1570  DIM  C<0:256) 

1580  INTEGER  1 1 , 12, 13, 14, 15, 16, 17, 18, 19, 1 10,  J,  K 

1590  DATA  1, .999981175283, .999924701839,. 99983058 1796, .999698818696, .9995294175 

01, .999322384588, .999077727753, . 998795456205, . 998475580573, .998118112900 

1600  DATA  .  397723066644,  .  997290456679, . 996820299291 , . 996312612183, . 995767414468 

, .995184726672, .994564570734, .993906970002, .993211949235, .992479534599 

?610  DATA  .991709753669, .990902635428, .990058210262, . 989 1 76509965 ,. 98825756773 1 

,  .987301418158, .986308097245, .985277642389, .984210092387,  .983105487431 

1620  DATA  .981963869110, .980785280403, .979569765685, .978317370720, .977028142658 

, . 975702130039, . 9743L9382786, . 972939952206, . 971503890986,  .  970031253195 

1630  DATA  .968522094274, .966976471045, .965394441698, .963776065795, .962121404269 

, .960430519416, .958703474896, .956940335732, .955141168306, .953306040354 

1  640  DATA  . 951435020969, . 949528180593, . 947585591018, . 94560732538 1 , . 943593458162 

,  .941544065183, .939459223602, .937339011913, .935183509939, .932992798835 

1650  DATA  .930766961079, .928506080473, .926210242138, . 92387953251 1 ,. 921514039342 

,  .919113851690, .916679059921, .914209755704, .91 .706032005, .909167983091 

1660  DATA  .906595704515, .903989293123, ,901348847046, .898674465694, ,895966249756 

, . 893224301196, . 890448723245, . 887639620403, . 884797098431 , . 881921264348 

1670  DATA  .879012226429, .876070094195, .873094978418, . 870086991 109, . 867046245516 

,  .863972856122,  .860866938638, .857728610000, .854557988365, .851355193105 

1680  DATA  .848120344803, . 844853565250, . 841554977437, . 838224705555, . 834862874986 

,  .831469612303, .828045045258, .824589302785, .821102514991, .817584813152 

1690  DATA  .814036329706, .810457198253, .806847553544, .803207531481, .799537269108 

, .795836904609, .792106577300, .788346427627, .784556597156, .780737228572 

1700  DATA  .776888465673,. 7730104^3363,. 769103337646  . 765167265622, . 761202385484 

,  .757208846506, .753186799044, .749136394523, .745057785441,  .740951125355 

1710  DATA  . 736816568877, . 732654271672, . 728464390448, . 724247082951 , . 720002507961 

, .715730825284, .711432195745, .707106781187, .702754744457, .698376249409 

1720  DATA  .693971460890, .689540544737, .685083667773, .680600997795, .676092703575 

, .671558954847, .666999922304, .662415777590, .657806693297, .653172842954 

1730  DATA  .648514401022, .643831542890, .639124444864, . 634393284164, . 629638238915 

,  .624859488142, .620057211763, .615231590581, .610382806276,  .605511041404 

1740  DATA  .600616479384, .595699304492, .590759701859, .585797857456, .580813958096 

,  .575808191418, .570780745887, .565731810784, .560661576197, .555570233020 

1750  DATA  .550457972937,  .545324988422, .540171472730, . 5349976 1 9887 ,. 529803624686 

, .524589682678, .519355990166, .514102744193, .508830142543, .503538383726 


A-4 


TR  7035 


1760  DATA  . 498227666973, .492898192230, .487550160148, . 482 1 83772079 , .476799230863 

, .471396736826, .465976495768, .460538710958, .455083587126, .449611329655 

1770  DATA  .444122144570, .438616238539, .433093818853, .427555093430, .422000270800 

, .416429560098, .410843171058, .405241314005, .399624199846, .393992040061 

1780  DATA  . 388345046699, . 382683432365, . 377007410216, . 371317193952, . 365612997805 

, .359895036535, .354163525420, . 3484 1 8680249 ,. 3426607 1 73 1 2 ,. 336889853392 

1790  DATA  .331106305760, . 325310292162, . 319502030816, .313681740399, .307849640042 

, .302005949319, . 296150888244, . 290284677254, . 28440753721 1 ,. 278519689385 

1800  DATA  .272621355450, .266712757475, .260794117915, .254865659605, .248927605746 

, .242980179903, .237023605994, .231058108281, .22508391 1360, .219101240157 

1810  DATA  .213110319916, .207111376192, .201104634842, . 195090322016, . 189068664150 

, . 183039887955, . 177004220412, .  170961888760, .  164913120490, .  158858143334 

1820  DATA  . 152797185258, . 146730474455, . 140658239333, . 134580708507, . 1284981 10794 

, . 122410675199, . 1 16318630912, . 110222207294, . 104121633872, . 980171403296E-1 

1830  DATA  .919089564971E-1, . 857973123444E-1 , . 7968243797 1 4E- 1 , . 735645635997E- 1 , . 

674439 1 95637E- 1 , . 6 1 3207363022E- 1 , . 551952443497E-1 , . 490676743274E- 1 

1840  DATA  .429382569349E-1, .368072229414E-1, . 30674803 1 766E- 1 , . 2454 1 2285229E- 1 , . 

184067299058E-1, . 1 227 1 5382857E- 1 ,. 6 1 35884649 1 5E-2 , 0 

1850  READ  CC*) 

I860  K»1024/N 

1870  FOR  J=0  TO  N/4 
1880  C<J>=C<K*J) 

1890  NEXT  J 
1900  Nl*N/'4 

1910  N2=N1+1 

1920  N3=N2+1 

1930  N4=N1+N3 

1940  Log2n=INT<1.4427*L0G<N)+.5) 

1950  FOR  Il»l  TO  Log2n 
I960  I2-2''<Log2n-in 

1970  13=2*12 

1980  I4=N/I3 

1990  FOR  15=1  TO  12 
2000  I6=<15-1 >*I4+1 

2010  IF  I6<=N2  THEN  2050 
2020  N6=-C<N4-IG-1) 

2030  N7=-C<I6-N1-1> 

2040  GOTO  2070 
2050  N6»C<I6-1> 

2060  N7=-C(N3-I6-n 

2070  FOR  17=0  TO  N-I3  STEP  13 

2080  18=17+15 

2090  19=18+12 

2100  N8=X<I8-1>-X<I9-1) 

2110  N9«Y<18-1>-Y<19-1) 

2120  X<I8-1>=X<I8-1)+X<I9-1) 

2130  Y<I8-l)  =  Y<I8-l)  +  Y<:i9-l) 

2140  X<I9-1>»N6*H8-N7*N9 

2150  Y<I9-1)=N6*N9+N7*N8 

2160  NEXT  17 
2170  NEXT  15 
2180  NEXT  11 
2190  Il=Log2n+l 

2200  FOR  12=1  TO  10  !  2''10=1024 

2210  C<12-1>»1 

2220  IF  I2>Log2n  THEN  2240 

2230  C<I2-1)»2^<I1-I2> 

2240  NEXT  12 
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2250 

K-1 

2260 

FOR  11»1  TO  C<9) 

2270 

FOR  12-11  TO  C<8> 

STEP 

C<9) 

2280 

FOR  13-12  TO  C<7) 

STEP 

C<8> 

2290 

FOR  14-13  TO  C<6> 

STEP 

C<7) 

2300 

FOR  15-14  TO  C<5) 

STEP 

C<6) 

2310 

FOR  16-15  TO  C<4> 

STEP 

C<5) 

2320 

FOR  17-16  TO  C<3) 

STEP 

C<4> 

2330 

FOR  18-17  TO  C<2) 

STEP 

C<3> 

2340 

FOR  19-18  TO  C<n 

STEP 

C<2) 

2350 

FOR  110-19  TO  C<0) 

STEP  C<1 

2360 

J-llO 

2370 

IF  K>J  THEN  2440 

2380 

fl-X<K-l) 

2390 

X<K-1)-X<J-1> 

2400 

X<J-l)-fl 

2410 

R-Y<K-n 

2420 

Y<K-1>-Y<J-1) 

2430 

Y<J-l>-fl 

2440 

K-K+1 

2450 

NEXT  no 

2460 

NEXT  19 

2470 

NEXT  18 

2480 

NEXT  17 

2490 

NEXT  16 

2500 

NEXT  15 

2510 

NEXT  14 

2520 

NEXT  13 

2530 

NEXT  12 

2540 

NEXT  11 

2550 

SUBENB 

A— 6 
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APPENDIX  8.  FADING  FOR  SECOND-ORDER  PROCESSOR 

This  program  computes  the  cumulative  and  exceedance  distribution 
functions  for  characteristic  function  (21),  when  the  power  fading  factor  r  in 

I  f 

(18)  has  probability  density  function  (19).  The  parameters  Dp  D2,  Nq,  Nj 

are  pre-computed  once  in  lines  210-310.  The  logarithms  in  lines  430  and  440 
have  arguments  that  never  cross  the  branch  line  along  the  negative  real  axis 
for  the  principal  value  logarithm;  hence  the  calculated  characteristic 
function  is  automatically  continuous  for  all  . 


20 

Nu«2.7 

j 

Power  law  for  fading 

30 

K»5 

! 

Number  of  terms  summed 

40 

flk».7 

! 

a<k>  weighting 

50 

Bk=-.9 

! 

b<k )  weight i ng 

60 

Ck*-.6 

! 

c<k)  weighting 

70 

P8T8  •2|.3j«4j— .Sj— .6 

! 

Means  of  random  variables 

80 

DfiTfl  ■8j'".7|  —  .61 .5|  .4 

! 

Means  of  random  variables 

90 

Ss*.  3 

1 

Standard  deviation  of  s<k) 

100 

St*.  2 

1 

Standard  deviation  of  t<k) 

110 

Rho*-. 4 

! 

Correlation  coeff.  of  s(k) 

120 

L*150 

1 

Limit  on  integral  of  char. 

130 

Bel t a*. 25 

( 

Sampling  increment  on  char 

140 

Bs«.625*<2*PI/Delta) 

! 

Shift  b,  as  fraction  of  al 

150 

Mf*2''8 

! 

Size  of  FFT 

160 

PRINTER  IS  0 

170 

PRINT  "L  *";L, "Delta 

*";Delta,’'b  =";Bs,"Mf  =";Mf 

180 

REDIM  Ms<i;K),Mt<l;K) 

,X<0 

:Mf-l),Y<0;Mf-l) 

190 

DIM  Ms<l: 10),Mt<l: 10> 

,X<0 

:1023),Y<0;  123> 

200 

READ  Ms<*),Mt<*) 

!  Enter  constants 

210 

M20»DOT<Ms,Ms) 

!  Calculation 

220 

M02*DOT<Mt,Mt) 

!  of 

230 

Mll-DOT<Ms,Mt) 

!  parameters 

240 

Tl»Ss*Ss 

250 

T2»St»St 

260 

T3*Rho#Ss*St 

270 

T4«4«flk*Bk-Ck*Ck 

280 

N0p*fik*M20+Bk*M02+Ck*Ml 1 

290 

Nlp-T4*<.5*<T2*M20+T1*M02)-T3*M11 > 

340 

Dl»2*<flk*Tl+Bk*T2+Ck*T3) 

310 

D2-T4»<l-Rho*Rho)*Tl*T2 

320 

Dlp«Dl+N0p'^Nu 

330 

D2p»D2+Nlp^N<i 

340 

Mux=N0p+. 5*K*D1 

!  Mean  of  random 

350 

Muy*Mux+Bs 

360 

T-Nu-.5*K 

s<k  ) 
t<k  > 


and  t ( k  > 
funct i on 
f unct i on 
as  inieroal 


gar i ab  1  e 


B-1 
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370 

380 

390 

400 

410 

420 

430 

440 

450 

460 

470 

480 

490 

500 

510 

520 

530 

540 

550 

560 

570 

580 

590 

600 

610 

620 

630 

640 

650 

660 

670 

680 

690 

700 

710 

720 

730 

740 

750 

760 

770 

780 

790 

800 

810 

820 

830 

840 

850 

860 

870 

880 


X<0>*0 

Y<0)*.  5*I>«Ua*Muy 
N-INT<L/De1t 
FOR  Ns«l  TO  N 
Xi "Del ta*Ns 
X2»Xi*Xi 

CALL  Log<l-X2*D2,-Xi*Dl,fl,B) 

CALL  Log<l-X2*D2p,-Xi*Dl|o,C,D) 

Tl»T*A-Nu*C 

T2*T*B-Nu*D+Bs*Xi 

CALL  Exp<Tl,T2,Fyr,Fy;i  ) 

Ms»Ns  MOD  Mf 
X<Ms)»X<Ms)+Fyr/Ns 
Y<Ms>«Y<Ms>+Fyi/'Ns 
NEXT  Ns 

CALL  Fftl02<Mf,X<*),Y<*)> 

PLOTTER  IS  “GRAPHICS" 

GRAPHICS 

SCALE  0,Mf,-14,0 
LINE  TYPE  3 
GRID  Mf/8,l 
PENUP 

LINE  TYPE  1 
B*Bs*Mf*DeUa/<2*PI  > 

MOVE  B,0 
DRAW  B,-14 
PENUP 

FOR  Ks*0  TO  Mf-1 
T»Y<Ks>/PI--Ks/'Mf 
X<Ks>-.5-T 
Y<Ks)«Pr».5+T 

IF  Pr>»lE-12  THEN  Y*LGT<Pr) 

IF  Pr<«-1E-12  THEN  Y— 24-LGT<-Pr) 
IF  ABS<Pr><lE-12  THEN  Y— 12 
PLOT  Ks,Y 
NEXT  Ks 
PENUP 

PRINT  Y<0>;YCl);Y<Mf-2);Y<:Mf-l) 

FOR  Ks«0  TO  Mf-1 

Pr«X<Ks> 

IF  Pr>»lE-12  THEN  Y-LGT<Pr> 

IF  Pr<  — lE-12  THEN  Y— 24-LGT<-Pr > 

IF  ABS<Pr><lE-12  THEN  Y—12 

PLOT  Ks,Y 

NEXT  Ks 

PENUP 

PAUSE 

DUMP  GRAPHICS 
PRINT  LIN<5) 

PRINTER  IS  16 
END 


!  Argument  xi  of  char.  fn. 
!  Calculation 
?  of 

!  characteristic 
!  function 
!  fy<xi) 

f  Coll  apsi  .'ig 


!  0  subscript  FFT 


Origin  for  random  variable  x 


!  Cumulative  probability  in  X<») 
!  Exceedance  probability  in  Y(*) 


B-2 
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890  SUB  Exp<X,Y,fl,B>  }  EXP<2) 

900  T«EXP<X) 

910  fl»T*COS<Y) 

920  B«T*S1N<Y> 

930  SUBEND 
940  ! 

950  SUB  Log<X,Y,fi,B)  !  PRINCIPAL  L0G<2) 

960  A».5*L0G<X*X+Y*Y> 

970  IF  XO0  THEN  1000 
980  B*.5*PI#SGN<Y> 

990  GOTO  1020 
1000  B-RTN<Y/'X> 

1010  IF  X<0  THEN  B»B+PI*<1-2*<Y<0)) 

1020  SUBENO 
1030  ! 

1040  SUB  Fftl02<N,X<»),Y<*))  !  N  <=  2''10  =  1024,  Nsa-^INTEGER  0  subscript 


B-3/B-4 
Reverse  Blank 
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APPENDIX  C.  NARROWBAND  CROSS-CORRELATOR 


This  program  con^Jutes  the  cumulative  and  exceedance  distribution 
functions  of  random  variable  (30)  via  characteristic  function  (35).  The 
parameters  Dj^^  Og,  Nq,  Nj  are  pre-computed  in  lines  280-390  and 
weighted  according  to  (35)-(36)  in  lines  400-440.  All  the  functions  employed 
are  analytic. 


le 

20 

30 

40 

50 

60 

70 

80 

90 

100 

110 

120 

130 

140 

150 

160 

170 

180 

190 

200 

210 

220 

230 

240 

250 

260 

270 

280 

290 

300 

310 

320 

330 

340 

350 

360 

370 

380 

390 

400 

410 

420 

430 

440 

450 

460 


!  NRRROMBRND  CROSS-CORRELRTOR 
K-5 
DRTR 
DRTR 
DRTR 
DRTR 
DRTR 
DRTR 
DRTR 
DRTR 
DRTR 
L«50 

D*1 5 

Bs».5*<2*PI/D€Ua> 

Mf»2''8 

PRINTER  IS  0 
PRINT  "L  »";L, "Delta 


.6f  —  .5f .4|— .3f  .2 
.9, .8,. 7, -.6, -.5 
-.6, -.8, 1, 1.2,  1.4 
.  1|*.2,— .3, .4,  .5 
".7, .6, .5,  .4,— .3 
.1,.3,.5,.7,.9 
.2, .4, .6,  .8,  1 
.4,  —  .5, .6,  .7,— .8 
•  9,  —  .7,  —  .5,  .3,  — .  1 


Number  of  terms  summed 
u<k)  weightings 

al<k>  signal  1  in-phase  components 

bl<k>  signal  1  quadrature  components 

a2<k>  signal  2  in-phase  components 

b2(k>  signal  2  quadrature  components 

sigmal<k>  noise  1  standard  deviations 
sigffla2(k>  noise  2  standard  deviations 
rho<k>  noise  in-phase  corr.  coeffs. 

lambda  noise  quadrature  corr.  coeffs. 

Limit  on  integral  of  char,  function 
Sampling  increment  on  char,  function 
Shift  b,  as  fraction  of  alias  interval 
Size  of  FFT 


Enter 
constants 
Cal  cul  at  i  on 
of 

parameters 


Delta, "b  *";Bs, "Mf 

REDIM  W<l:K),fll<l:K),Bl<l;K),R2<l;K),B2< 1:K) 

REDIM  Sl<l:K),S2<l:K),Rho<i:K>,Lambda<i:K> 

REDIM  D1<1:K),D2<1:K),N0<1:K),N1<1:K) 

REDIM  X<0:Mf-l), Y<0:Mf-l),W2<l;K> 

DIM  M<i: 10>,R1<1: 10>,B1<1: 10>,R2<1: 10>,B2<1: 10> 

DIM  si<i: 10>,S2<1: 10),Rho<l: 10),Lambda<l: 10> 

DIM  Did:  10),D2<1:  10>,N0<i:  10>,N1(1: 10> 

DIM  x<0: 1023), Y<0: 1023), U2<l: 10) 

RERD  W<«),R1<*),B1<*),R2<»),B2<*) 

RERD  Sl<»),S2<*>,Rho<*),Lambda<*> 

FOR  J-1  TO  K 
SIs»Sl<J)‘'2 
S2s»S2<J)''2 
T1«S1<J)*S2<J) 

Dl<J)-T2-Tl»Rho<J) 

D2<J>-.25»Sl5*S2s*<l-Rho<J>''2-Lambda<J>"2) 

T3-Rl<J>*fl2<J)+Bl<J)*B2<J> 

N0<J)-.5*T3 

T4»fl2<J)*Bl<J>-Rl<J)*B2<J> 

T5«S2s»<Rl<J>‘'2+Bl  <J)^2)+Sls*<R2<J)‘^2+B2<J)'^2) 

N1<J)-. 125*<T5-2*T2*T3-2*Tl»Lambda<J>*T4> 

NEXT  J 
MRT  W2-W.W 
MRT  Dl-W.Dl 
MRT  D2-M2.D2 
MRT  N0-U.N0 
MRT  N1-U2.N1 

Mux*SUM<N0)+SUM<Dl >  I  Mean  of  random  variable  v 

Muy*Mux+B» 


C-l 


TR  7035 


470  X<0)»0 

480  Y<0)*. 5*D#1 ta*Muy 

490  N»INT<L/DeUa) 

500  FOR  Ns»l  TO  N 

510  Xi*DeUa*Ns 

520  X2=Xi*Xi 

530  Pr=l 

540  Pi®Sr»Si»0 

550  FOR  J*1  TO  K 

560  Dr»i+X2»D2<J) 

570  Di— Xi*Dl<J) 

580  CfiLL  Mul <Pr,ei ,Dr,Di 

590  Pr*fl 

600  Pi»B 

610  CRLL  D1v<N0<J),Xi*Nl<J),Dr,Di ,fi,B> 

620  Sr«Sr+fl 

630  Si=Si+B 

640  NEXT  J 

650  CALL  Exp<-Xi*Si ,Xi*<Sr+Bs),fl,B> 

660  CALL  Di v< A, B, Pr, Pi , Fyr , Fy i ) 

670  Ms*Ns  MOB  Mf  ! 

680  X<Ms)=X<Ms)+Fyr/'Ns 

690  Y<Ms)»Y<Ms)+Fyi/'Ns 

700  NEXT  Ns 

710  CALL  Fftl0z<Mf,X<*),Y<*))  ! 

720  PLOTTER  IS  "GRAPHICS" 

730  GRAPHICS 

740  SCALE  0,Mf,-14,0 

750  LINE  TYPE  3 

760  GRID  Mf/'S,  1 

770  PENUP 

780  LINE  TYPE  I 

790  B*Bs*Mf*DeUa/-<2«PI)  ! 

800  MOVE  B,0 

810  DRAM  B,-14 

820  PENUP 

830  FOR  Ks=0  TO  Mf-1 

840  T»Y<Ks)/PI-Ks>'Mf 

850  X<Ks)-.5-T  ! 

860  Y<Ks)=Pr«.5+T  ! 

870  IF  Pr>»lE-12  THEN  Y=LGT<Pr) 

880  IF  Pr<»-1E-12  THEN  Y«-24-LGT<-Pr ) 

890  IF  ABS<Pr)<lE-12  THEN  Y*-12 

900  PLOT  Ks,Y 

910  NEXT  Ks 

920  PENUP 

930  PRINT  Y<8);Y<n;Y<Mf-2);Y<Mf-l> 

940  FOR  Ks»0  TO  Mf-1 

950  Pr»X<Ks) 

960  IF  Pr>=lE-12  THEN  Y»LGT<Pr) 

970  IF  Pr<«-1E-12  THEN  Y«-24-LGT<-Pr> 

980  IF  ABS<Pr><lE-12  THEN  Y— 12 

990  PLOT  Ks,Y 

1000  NEXT  Ks 

1010  PENUP 

1020  PAUSE 


Argument  xi  of  char.  fn. 
Cal  cul  at  i  on 
of 

characters  st i c 
f unct i on 
fy<xi  > 


Col  1 apsi ng 


0  subscript  FFT 


Origin  for  random  variable  v 


Cumulative  probability  in  X<*) 
Exceedance  probability  in  Y<*) 


C-2 
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i030  DUMP  GRAPHICS 
1040  PRINT  LIN<5> 

1050  PRINTER  IS  16 
1060  END 

1070  ! 

1080  SUB  MuKXl,Yl,X2,Y2,fl,B)  !  21*22 

1090  fl«Xl*X2-Yl*Y2 

1100  B*X1*Y2+X2*Y1 

1110  SUBEND 

1120  ! 

1130  SUB  Div(Xl,Yl,X2,Y2,R,B)  !  21/22 

1140  T*X2*X2+Y2*Y2 

1150  fl»<Xl*X2+Yl*Y2)/T 

1160  B«<Y1*X2-X1*Y2)/T 

1170  SUBEND 

1180  ! 

1190  SUB  Exp<X,Y,fl,B)  !  EXP<2> 

1200  T»EXP<X) 

1210  fl«T*C0S<Y> 

1220  B=T*SIN<Y) 

1230  SUBEND 
1240  ! 

1250  SUB  Fftl0z<N,X<*),Y<*))  •  N  =  2^10  »  1024,  N»2^INTEGER 


0  subscript 


C-3/C-4 
Reverse  Blank 
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I 


APPENDIX  D,  REDUCED  QUADRATIC  AND  LINEAR  FORM 


This  program  computes  the  cumulative  and  exceedance  distribution 
functions  of  random  variable  (65)  via  characteristic  function  (66).  The 
required  inputs  to  the  program  are  M  and  the  of  (68). 

The  square  root  in  (66)  must  again  be  continuous  and  is  handled  exactly  as  in 
appendix  A.  The  parameters  required  in  the  exponential  of  (66)  are 
pre-computed  in  lines  170-210,  and  the  mean  of  q  is  entered  in  line  220. 


REDUCED  QUADRATIC  AND  LINEAR  FORM 


M=5 

DATA 

DATA  - . 1 , . 3, . 5, . 7 , - . 9 
DATA  . 6 , . S , - . 4 1 - . 3 , . 2 
L>80e 
Del ta=. 38 

Bs=.  5«<2*PI/'DeUa) 
Mf*2'^10 


Number  of  terms  summed 
Lambda  ual ues 
d  values 
Nu  values 

Limit  on  integral  of  char,  function 
Sampling  increment  on  char,  function 
Shift  b,  as  fraction  of  alias  interval 
Size  of  FFT 


PRINTER  IS  0 

PRINT  "L  =";L, "Delta  =";Delta,"b  =";Bs,"Mf  =";Mf 
REDIM  Lambda<l:M),D<l:M),Nu<l:M),R<l;M),B<l:M),C<l:M> 
REDIM  X<0SMf-l),Y<0:Mf-l) 

DIM  Lambda<l: 10>,D<1: 10>,Nu<l: ie> , A( 1 : 1 0> , B( 1 : 10> , C< 1 : 10> 
DIM  X<0: 1023), Y<0; 1023) 


READ  Lambda<*),D<*>,Nu<*)  !  E 

FOR  Ms*l  TO  M  •  C 

A<Ms>=2*Lambda<Ms)  !  o 

B<Ms)*<LambdaCMs)*Nu<Ms)+D<Ms>)*Nu<Ms) 
C<Ms)».5*D<Ms)''2 
NEXT  Ms 

Muq=SUM<:Lambda)+SUM<B)  !  M 

R-0  !  A 

P»1  !  P 

Muy*Muq+Bs 
X<0)*0 

Y<0)=.5»Delta*Muy 

N»INT<L/'Delta) 

FOR  Ns«l  TO  N 

Xi*Delta*Ns  !  A 

Pr*l  !  C 

Pi«Sr«Si*0  !  o 

FOR  Ms-1  TO  M  !  c 

T— A<Ms)*Xi  !  f 

CALL  Mu1 <Pr,Pi , 1,T,A,B)  !  f 

Pr=A 
Pi«B 

CALL  Di v<B<Ms),C<Ms)*Xi , 1,T,A,B) 
Sr-Sr+A 
Si -Si +B 
NEXT  Ms 


Enter  constants 
Cal cul at  i  on 
of  parameters 


Mean  of  random  variable  q 
Argument  of  square  root 
Polarity  indicator 


Argument  xi  of 
Cal  cul  at  i  on 
of 

character! st i c 
f unct i on 
fyCxi  ) 


of  char. 


TR  7035 

420  CALL  Exp<-Si *Xi , (Sr+Bs)*Xi 

430  CALL  Sqr<Pr,Pi ,C,D> 

440  Ro*R 

450  R»ATN<D^C) 

460  IF  ABS<:R-Ro>>1.6  THEN  P*-P 

470  CALL  Diw<A,B,C*P,D*P,Fyr,Fyi ) 

480  Ms*Ns  MOD  Mf  !  Collapsing 

490  X<Ms)=X<Ms>+Fyr/Ns 

500  Y<Ms>»Y<Ms)+Fyi/'Ns 

510  NEXT  Ns 

520  CALL  Fftl0z<Mf ,X<*), Y<*))  !  0  subscript  FFT 

530  PLOTTER  IS  "GRAPHICS" 

540  GRAPHICS 

550  SCALE  0,Mf,-14,0 

560  LINE  TYPE  3 

570  GRID  Mfx8, 1 

580  PENUP 

590  LINE  TYPE  1 

600  B*Bs*Mf»D«1  ta/'<2*PI )  !  Origin  for  random  variable  q 

610  MOVE  B,0 

620  DRAW  B,-14 

630  PENUP 

640  FOR  Ks«0  TO  Mf-1 

650  T-Y<Ks)/’PI-Ks/Mf 

660  X<Ks)»».5-T  !  Cumulative  probability  in  X<*> 

670  Y<Ks)»Pr*. 5+T  !  Exceedance  probability  in  Y<*) 

680  IF  Pr>-1E-12  THEN  Y=LGT<Pr) 

690  IF  Pr<*-1E-12  THEN  Y— 24-LGT<-'Pr > 

700  IF  ABS<Pr)<lE-12  THEN  Y—12 

710  PLOT  KS,Y 

720  NEXT  Ks 

730  PENUP 

740  PRINT  Y<0>;Y<l>;Y<Mf-2);Y<Mf-l> 

750  FOR  Ks*0  TO  Mf-1 

760  Pr»X<Ks) 

770  IF  Pr>«lE-12  THEN  Y-LGT<Pr) 

780  IF  Pr<»- lE-12  THEN  Y«-24-LGT<-Pr > 

790  IF  ABS<Pr)<lE-12  THEN  Y*-12 

800  PLOT  Ks,Y 

810  NEXT  Ks 

820  PENUP 

830  PAUSE 

840  DUMP  GRAPHICS 

850  PRINT  LIN(5) 

860  PRINTER  IS  16 

870  END 

880  I 


0-2 
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890  SUB  Mu1 <Xl,Yl,X2,Y2,fl,B) 
900  R*X1*X2-Y1»Y2 

910  B«X1*Y2+X2*YI 

920  SUBEND 
930  ! 

940  SUB  DiM<Xl,Yl,X2,Y2  fl,B> 

950  T*X2*X2+Y2*Y2 

960  R»<X1*X2+Y1»Y2>^T 

970  B»<Y1*X2-X1«Y2)/'T 

980  SUBEND 

990  ! 

1000  SUB  Exp<X,Y,R,B> 

1010  T*EXP<X) 

1020  R«T*C0S<Y) 

1030  B*T*SIN<Y> 

1040  SUBEND 
1050  ! 

1060  SUB  Sqr<X,Y,R,B> 

1070  IF  XO0  THEN  1110 
1080  RaB-SQR<.5*RBS<Y>> 

1090  IF  Y<0  THEN  B--B 

1100  GOTO  1220 

1110  F«SQR<SQR<X*X+Y*Y)) 

1120  T».5*flTN<Y/'X) 

1130  fl»F*COS<T) 

1140  B-F«S1N<T> 

1150  IF  X>0  THEN  1220 
1160  T»R 
1170  R*-B 
1180  B-T 

1190  IF  Y>=0  THEN  1220 

1200  fl»-R 

1210  B— B 

1220  SUBEND 

1230  ! 

1240  SUB  Fftl0z<N,X<*),Y<*)) 


•  Z1«Z2 


!  21/Z2 


!  EXP<Z) 


!  PRINCIPRL  SQR<Z) 


!  N  <»  2''10  ■  1024,  N-Z-'INTEGER 


0  subscript 


D-3/D-4 
Reverse  Blank 


APPENDIX  E.  SIMULATION  OF  SECOND-ORDER  PROCESSOR 


This  program  simulates  random  variable  x  in  second-order  processor  (8) 

directly.  The  weights  and  statistics  are  entered  in  lines  30-130.  A  pair  of 

independent  zero-mean  unit-variance  Gaussian  random  variables  are  generated  in 

lines  310-380.  The  sample  cumulative  and  exceedance  distribution  functions 

are  computed  in  lines  510-590. 

10  !  SIMULATION  OF  SECOND-ORDER  PROCESSOR 

20  Tt®10000  !  Number  of  trials 

30  K*5  !  Number  of  terms  summed 

40  DATA  . 6, -. 5, . 4, -. 3, . 2  !  a<k>  weightings 

50  DATA  , 9, . 8, . 7, 6, -. 5  !  b<k>  weightings 

60  DATA  -. 6, -. 8, 1 , 1 . 2, 1 . 4  !  c<k)  weightings 

70  DATA  . I , 2, -. 3, . 4, . 5  I  d<k>  weightings 

80  DATA  7, . 6, . 5, . 4, 3  !  e<k>  weightings 

90  DATA  . 2, . 3, . 4, -. 5, -. 6  !  Means  of  random  variables  s<k> 

100  DATA  . 8, 7, -. 6, . 5, . 4  !  Means  of  random  variables  t<k) 

110  DATA  . 1 , . 3, . 5, . 7, . 9  !  Standard  deviations  of  s<k) 

120  DATA  . 2, . 4, . 6, . 8, 1  !  Standard  deviations  of  t<k) 

130  DATA  . 4, -. 5, . 6, . 7, -. 8  !  Correlation  coeffs.  of  sCk)  and  t<k) 

140  REDIM  a<i;K),b<i;K),c<i;k),d<i;k),e<1:k> 

150  REDIM  Ms<l:K),Mt<l:K),Ss<l:K>,St<l;K),Rho<l;K> 

160  REDIM  A1 (l:K>,Be<l:K>,X<l:Tt) 

170  DIM  A<i; 10>,B<1: l0),c<i: 10),D<1; 10),E<1: 10) 

180  DIM  Ms<l; l0),Mt<l; i0),Ss<l; l0),St<i: l0),Rho(i: 10) 

190  DIM  A1 <l: 10),Be(l: 10),X<1: 10000) 

200  READ  A<*),B<*),C<*),D<*),E<*) 

210  READ  Ms<*),Mt<*)vSs<*),St<*),Rho<*) 

220  FOR  J»1  TO  K 

230  A1 < J)»Ss<J)*Rho< J) 

240  Be<J)»Ss<J)*SQR<l-Rho<J)''2) 

250  NEXT  J 

260  RANDOMIZE  SQR<.6) 

270  L-L0G<.25) 
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280 

FOR  1-1  TO  Tt 

290 

X»0 

300 

FOR  J-1  TO  K 

310 

V1-RND-.5 

!  GENERATE  TWO 

320 

V2*RND-.5 

!  INDEPENDENT 

330 

S»V1*V1+V2*V2 

!  GAUSSIAN 

340 

IF  S>.25  THEN  310 

!  RANDOM 

350 

Q-<L-LOG<S))/S 

!  VARIABLES  VIA 

360 

Q>SQR<Q-«-Q> 

!  ACCEPTANCE 

370 

Gl-VUQ 

!  AND 

380 

G2>V2»Q 

!  REJECTION 

390 

S«Ms<J>+fll <J)*G1+Be< J)*G2 

400 

T»Mt  < J>+St<J)#Gl 

410 

X»X+fl< J)*S»S+B<J>*T*T+C<J)*S»T+D< J>*S+E< J)*T 

420 

NEXT  J 

430 

x<n«x 

440 

NEXT  1 

450 

HAT  SORT  X 

460 

PLOTTER  IS  "GRAPHICS" 

470 

GRAPHICS 

480 

SCALE  “30,10,-4,0 

490 

GRID  5, 1 

500 

PENUP 

510 

FOR  I-l  TO  Tt 

520 

Y-LGT<<I-.5>/'Tt> 

530 

PLOT  X<I),Y 

540 

NEXT  I 

550 

PENUP 

560 

FOR  I-l  TO  Tt 

570 

Y-LGT<l-<I-.5>/Tt) 

580 

PLOT  X<I),Y 

590 

NEXT  1 

600 

PENUP 

610 

END 

E-2 
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Characteristics  for  Linear 
Sum  of  Envelopes  of 
Narrowband  Gaussian 
Process  and  Sinewave 


A.  H.  Nuttall 

B.  Dedreux 

ABSTRACT 

The  characteristic  function  of  a  linear  sum  of  M  independent  Rice 
variates  is  derived  and  evaluated  exactly  and  then  used  in  a  numerical 
procedure  to  determine  the  exceedance  distribution  function,  as  a 
function  of  the  threshold,  the  input  signal-to-noise  ratio  (SNR),  and  M. 
Plots  of  the  detection  probability  and  false  alarm  probability  for  a  wide 
range  of  SNR’s  are  given,  for  values  of  M  up  to  8192.  In  addition,  the 
required  threshold  values  and  input  SNR’s  are  tabulated  and  plotted 
for  specific  values  of  M,  false  alarm  probability,  and  detection 
probability.  A  program  and  explanation  are  included  for  those  users 
interested  in  extending  results  to  their  particular  application. 
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EXACT  OPERATING  CHARACTERISTICS  FOR  LINEAR  SUM  OF 
ENVELOPES  OF  NARROWBAND  GAUSSIAN  PROCESS  AND  SINEWAVE 

INTRODUCTION 

The  operating  characteristics  for  a  linear  envelope-detector  of  a 
sinewave  in  narrowband  Gaussian  noise,  followed  by  summation  of  M  independent 
envelope  samples,  were  presented  in  [1]  and  [2,  sect.  8.3].  That  approach  was 
based  upon  evaluation  of  the  first  31  moments  of  the  envelope  variate  and 
their  use  in  a  type  A  Gram-Charlier  series  approximation,  or  in  modified 
approximations  involving  averages  over  different  numbers  of  terms  in  the 
series  [1,  pp.  758-9].  However,  there  are  possible  pitfalls  to  the  above 
approach.  First,  evaluation  of  very  low  exceedance  probabilities,  like 
10“^^,  may  be  inaccurate;  see  [1,  Fig.  1].  Second,  the  effect  of  a 
systematic  error  would  be  hard  to  detect,  if  present,  since  the  method  yields 
only  an  approximation  to  the  exceedance  distribution  function,  and  not  its 
exact  value. 

We  will  use  an  exact  approach  here,  based  upon  evaluation  of  the 
characteristic  function  of  the  envelope  detector  output,  from  which  the 
exceedance  distribution  function  can  be  precisely  evaluated  numerically 
[3,4].  In  this  fashion,  we  avoid  moment  evaluations  altogether;  we  can 
evaluate  false  alarm  probabilities  in  the  10“^^  range  easily  (with  double 
precision  computer  arithmetic);  and  we  can  control  truncation  and  aliasing 
errors  to  any  desired  degree;  see  [3]  for  details.  The  results  of  [4]  can  not 
be  applied  here  because  each  independent  envelope  sample  is  the  result  of  a 
nonlinear  operation,  namely  a  square  root,  applied  to  a  sum  of  two  squares  of 
Gaussian  random  variables  with  non-zero  means. 

In  the  plots  of  detection  probability  vs.  false  alarm  probability  to  be 
presented  herein,  both  abscissa  and  ordinate  use  the  same  normal  probability 
scales,  regardless  of  the  number  of  envelope  samples  M  considered.  This  allows 
for  easier  interpolation,  and  is  in  distinction  to  [1],  where  a  different 
false  alarm  probability  abscissa  was  used  for  each  M  [1,  pp.  759-62].  Also, 
the  parameter  employed  here  for  indexing  the  curves  is  a,  a  voltage  signal- 
to-noise  ratio  which  is  equal  to  the  ratio  of  the  sinewave  amplitude  to  the 
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rms  noise  level,  rather  than  the  d8  parameter  employed  in  [1],  This  leads  to 
curves  that  are  more  nearly  equally  spaced,  and  therefore  to  easier  and  finer 
interpolation  capability. 

Finally,  we  present  five  figures  for  the  required  input  signal-to- 
noise  ratio  per  sample  required  to  realize  specified  false  alarm  and  detection 
probabilities,  as  a  function  of  M,  the  number  of  envelope  samples  added.  The 
five  figures  correspond  to  detection  probability  Pq».5,  .9,  .95,  .99,  and 
.999  respectively,  and  each  figure  contains  false  alarm  probabilities 
Pp^=10“'^  for  n=l(l)8.  This  total  of  40  curves  greatly  augments  the  2 
cases  presented  in  [1,  Fig.  16]  and  [2,  Fig.  8.18]. 

A  program  for  the  evaluation  of  the  input  signal-to-noise  ratio 
required  for  a  specified  set  of  values  of  M,  Pp^,  and  Pq  is  furnished, 
along  with  an  explanation  of  its  use.  In  this  fashion,  values  of  M,  Pp^, 
and  Pq  intermediate  to  those  considered  here  can  be  easily  investigated. 
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METHOD  OF  EVALUATION 

Characteristic  Function  Details 

In  [3,4],  a  method  of  calculating  the  cumulative  and  exceedance 
distribution  functions  directly  from  a  given  characteristic  function  was 
presented.  To  utilize  those  results  here,  we  need  the  characteristic  function 
of  summation  random  variable 

M 

m^l 

where  e  is  the  envelope  of  a  narrowband  filter  output  with  a  sinewave 

*  ? 
signal  of  amplitude  A  and  Gaussian  noise  of  power  a^.  Through  proper 

normalization,  the  probability  density  function  of  envelope  e^  takes  the 

familiar  Rice  form 


pg(u)  =  u  exp 


(ou)  for  u  ^  0  , 


where  the  single  parameter 


(3) 

is  a  voltage  measure  of  signal-to-noise  ratio  per  envelope  sample.  The  power 
measure  of  signal-to-noise  ratio  per  sample  is 

S  A^/2 

F  — r  “  T"  • 

a 

The  quantities  in  (3)  and  (4)  will  be  referred  to  as  input  signal-to-noise 
ratios,  since  they  are  per-sample  measures,  prior  to  the  summation  in  (1) 
which  yields  the  output  or  decision  variable  x. 


The  characteristic  function  corresponding  to  random  variable  e  in  (2)  is 
given  by  Fourier  transform 
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^  /  2  2\ 

)  =  Jdu  exp(ifu)  Pg(u)  =  Jclu  u  exp/iju  -  H l^(au)  ,  (5) 

and  will  be  called  the  Rice  characteristic  function.  A  series  expansion  for 
(5)  is  developed  in  appendix  A,  and  has  been  programmed  in  double  precision 
for  numerical  use  here.  As  a  particular  special  case,  for  a=0,  no  signal,  we 
have  the  Rayleigh  probability  density  function  and  characteristic  function: 

Pg°^(u)  =  u  exp(-u^/2)  for  u  ^  0  » 

=■  exp(-j2/2)  f  ^  •  (6) 

The  latter  follows  by  use  of  [5,  3.896  3|a]  and  via  manipulation  of  the 
hypergeometric  function  series  along  with  Kummer's  transformation  [5,  9.212  1]. 
Formula  (6)  is  particularly  attractive  numerically,  since  the  series  expansion 
of  contains  all  negative  terms  except  for  one.  It  should  be  observed 

that  the  imaginary  part  of  Rayleigh  characteristic  function  fg°^(5)  io  (6) 
decays  very  rapidly  witht;  this  useful  feature  will  also  be  shared  by  the 
Rice  characteristic  function,  f^  (T).  and  is  due  to  the  fact  that  the  odd 
part  of  the  Rice  probability  density  function  in  (2)  is  smooth  for  all  u,  and 
is  in  fact  entire  in  u,  for  any  a.  By  contrast,  the  even  part  of  the  Rice 
probability  density  function  in  (2)  has  a  discontinuous  derivative  for  real  u, 
thereby  leading  to  slow  decay  of  the  real  part  of  f^  (f). 

The  characteristic  function  of  output  variable  x  in  (1),  for 
statistically  independent  envelope  samples  fe  "j,  is  given  by 


f^if)  =  .  (7) 

in  terms  of  the  Rice  characteristic  function  (5).  This  relation  could  be  used 
directly  to  find  the  exceedance  distribution  function  of  x  according  to 
[3.  {5M6)] 

7  1  T  T 

Qj^(u)  »  J  dt  p^(t)  «  •2-  +  j  dT  Im|exp(-iuf)  .  (8) 
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However,  the  slow  decay  of  prompts  us  to  use  a  modified  version 

given  in  [6,  (15)]: 

Qj^(u)  =  I  I  ^  cos(uf)  Im|f^{f )}  for  u  >  0  .  (9) 

This  form  is  applicable  to  positive  random  variables,  of  which  x,  as  given  by 
(1)  and  (2),  is  certainly  a  member- 

To  see  why  form  (9)  is  preferred  over  (8),  we  develop  (7)  as 

f,(?)  -  [f/r)  ^  ^  (”)  i"  [fiCf)]”  .  (10) 

m=0 

where  f^(f)  and  f^^)  are  the  real  and  imaginary  parts  of  Rice 
characteristic  function  fg(jf').  Then 

M  ^*“1 

2  (-1)”^  (”)  (11) 

m=l 
m  odd 

contains  f^  (f)  to  at  least  the  first  power  in  all  terms,  thereby  yielding  a 
rapid  decay  with  f . 

Development  (11)  has  been  used  to  show  why  Im  l^(r)}  decays  rapidly 
withf.  However,  when  we  employ  (9)  in  a  numerical  evaluation,  we  simply  take 
the  imaginary  part  of  the  power  in  (7),  and  do  not  use  (11)  at  all;  (11)  is  an 
alternating  series  of  large  terms  for  large  M. 

Actual  numerical  evaluation  of  (9)  proceeds  as  follows  [3]:  for  the 
Trapezoidal  rule  with  sampling  increment  a  in  f. 
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where  we  used  f^(|)-^l  +  ijj^  as  /■♦O.  Then,  restricting  the  u  values  to 
a  particular  selection, 

"  ii  cos(2.™n/N)  . 

L  nal  ^ 

N-1 

=  7  Re^  2  exp(-i2irmn/N)  ,  (13) 

*  n«0  " 

where  collapsed  sequence  is  defined  as 

flO 

^0  “  7V  2  IF!  JNa)}  . 

J=1 

^n  =*  2  n^  l<n<N-l  .  (14) 

0«O 

Form  (13)  is  particularly  attractive  since  it  can  be  accomplished  via  an 
N-point  FFT.  It  can  be  shown  that  only  the  values  for  0  £  m  £  N/2  are  useful 
in  (13);  the  remainder  are  heavily  aliased  and  must  be  discarded.  Thus  there 
is  a  trade-off:  use  of  only  the  imaginary  part  of  fj((5)  results  in  aliasing 
twice  as  coarse.  However,  the  rapid  decay  of  the  imaginary  part  far  outweighs 
the  aliasing. 

The  summations  in  (12)  and  (14)  cannot  be  conducted  to  infinity.  Rather 
the  integral  on  f  in  (9)  is  terminated  at  limit  L,  where  the  truncation  error 
is  guaranteed  to  be  sufficiently  small.  A  trial  and  error  procedure  [3] 
yielded  the  following  rules  which  control  the  truncation  and  aliasing  errors: 

L  =  min  (9,  ulTR), 

A  =  .12//)?, 

b  =  min  (0,  -MV;r72'  + VFTe).  (15) 

The  inverse  V^depe^dence  of  L  and  a  for  large  M  can  be  anticipated  by 

observing  that  the  characteristic  function  of  random  variable  x  in  (1)  then 
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approaches  a  Gaussian  function  with  argument  proportional  to  The  bias 

(or  shift)  b  is  added  to  random  variable  x  in  order  to  yield  a  new  random 

variable  that  remains  just  positive,  even  for  large  M;  this  allows  us  to  take 

maximum  advantage  of  the  fundamental  aliasing  interval  (0,  ir/a)  in  u  in  (12) 
and  (13).  The  linear  term  (in  M)  of  b  in  (15)  is  due  to  the  mean  of  the 

Rayleigh  variate  (for  a=0)  which  is  the  algebraic  term  in^FTis  due  to 

the  fact  that  the  standard  deviation  of  random  variable  x  in  (1)  increases 
according  to^fW. 

In  order  to  use  this  characteristic  function  approach,  we  also  need  the 
mean  of  random  variable  x  in  (1).  Using  (2),  this  is  given  by  [5,  6.631  1] 

Ux  =  Mve  *  M  J du  u^  exp  ^  ^  “ 

«  M  (f)^^^  exp(-  1;  pj  .  (16) 

This  non-alternating  series  yields  accurate  values  for  the  mean. 

Special  Cases 


For  general  M,  the  characteristic  function  approach  described  above  must 
be  used.  However,  for  M  =  1  and  2,  closed  form  expressions  for  the  false 
alarm  and  detection  probabilities  are  possible.  Specifically,  from  (1)  and 
(2),  for  u  >  0, 


And  for  M  =  2,  the  false  alarm  probability  can  be  determined  by  convolving  two 
Rayleigh  probability  density  functions  of  the  form  of  (6),  to  give,  for  u  ^  0, 
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'FA 


exp(-u'^/2)  +  yr  u  expC-u'^/A) 


%)  ■  ^ 


for  M  »  2.  (18) 


Here,  $  is  the  cumulative  distribution  function  of  a  normalized  Gaussian 
random,  variable: 


u 

|■(u)  =  J  dt  (2w)“^'2  exp{-t2/2)  .  (19) 

-» 

The  detection  probability  of  random  variable  x  in  (1)  is  not  available  in 
closed  form  for  M  >  1. 


Asymptotic  Performance  for  Large  M 

For  large  M,  decision  variable  x  in  (1)  is  approximately  Gaussian.  The 
mean  of  x  was  given  in  (16);  a  similar  approach  for  the  mean  square  of  x 
yields  the  variance  as 


K  -  Ma?  =  M(2+a^-M?)  . 


(20) 


The  probability  density  function  of  x  is  then  approximately 


1 


P„(u)  s 


exp 


2a? 


(21) 


with  exceedance  distribution  function 


Qx(u)  s  J| 


(22) 


For  input  signal-to-noise  ratio  S/N=0,  we  have  t»»0  from  (4),  and  (22), 
(16),  and  (20)  specialize  to 


'’fa* 


r/Mlg7?-u  \ 


(23) 


8 


On  the  other  hand,  for  S/N>0,  (22)  yields  the  detection  probability  Pq.  We 
now  use  the  inverse  function^  to  definition  (19)  and  solve  (23)  and  (22) 
according  to 


Mug-u 


Eliminating  threshold  u  in  (24),  we  have 


(24) 


But  also,  for  large  M,  the  required  per-sample  input  signal-to-noise  ratio  a 
will  be  small,  giving 


Substituting  these  results  in  (25)  and  solving  for  o,  we  have  the  required 
per-sample  input  signal-to-noise  ratio  measures  for  large  M  in  the  alternative 
forms 


1/4  MZ  .1/2 

=  1.446  ^ 

W 


.  A-irV'  B 


1/2 


N  =  7” 


a  2 


fn  - 


dB  «  10  log  10  log^2|^^J+10  log(B)-5  log(M)  »  .193+10  log(B)-5  log(M),  (27) 


where  the  single  parameter 


incorporates  the  specified  false  alarm  and  detection  probabilities.  (27) 
displays  the  familiar  5  log  M  decibel  decay  for  large  M  associated  with  the 
incoherent  addition  in  (1);  see  also  [2,  p.  279,  Ex.  8.8]. 
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RESULTS 

For  a  given  value  of  M,  the  output  variable  In  (1), 

* = •  <«> 
m»l 

will  exceed  threshold  u  with  false  alarm  probability  ^FA  when  signal-to-nolse 
ratio  a  Is  zero.  That  Is 


Pp^  s  Prob(x>uj  oaO;  M).  (30) 

For  specified  values  of  M  and  ^FA*  this  relation  can  be  solved  numerically 
for  u;  the  values  of  normalized  threshold  u/M  are  listed  In  table  1  for 
n=0(l)13  and  for  Pp^^lO"",  n=l{l)a. 

The  detection  probability  depends  on  threshold  u,  M»  and  signal-to-nolse 
ratio  a(>0): 


Pq  =  Prob(x>u  I  a;  M).  (31) 

For  specified  values  of  M,  Pp,  and  u,  this  relation  can  be  solved 
numerically  for  the  required  Input  signal-to-noise  ratio  o.  When  the 
threshold  results  in  Table  1  are  employed,  the  results  yield  the  required 
input  signal-to-nolse  ratio  for  specified  false  alarm  probability  and  detection 
probability  at  a  particular  M.  These  are  plotted  in  figures  1-5  for 

Pp  =  .5.  .9,  .95,  .99,  .999,  (32) 

respectively.  The  abscissa  is  1og2M,  and  the  ordinate  Is  In  decibels,  as 
defined  in  (27).  The  fit  of  (27)  Is  very  good  for  large  M,  especially  for 
the  larger  ^FA  values.  These  results  in  figures  1-5  greatly  extend  the  one 
In  [1,  Fig.  16]  and  [2,  Fig.  8.18]. 
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Table  1.  Normalized  Thresholds  Required  for  Specified  M  and 


XP 

M\FA 

lE-1 

lE-2 

1 

2»14596603 

3.03485426 

2 

1*87154046 

2*46578168 

4 

1*68491649 

2*08494224 

8 

1*55592564 

1 .82779134 

16 

1*46605729 

1*65246898 

32 

1*40314416 

1.53192213 

64 

1*35896377 

1*44846093 

128 

1*32787317 

1.39035933 

256 

1 *30596258 

1*34974198 

512 

1 *29050601 

1*32125803 

1024 

1.27959472 

1*30123656 

2048 

1*27188832 

1 *28713956 

4096 

1*26644357 

1*27720181 

8192 

1*26259580 

1 *27018998 

lE-5 

lE-6 

1 

4.79852591 

5*25652177 

2 

3*65817649 

3*97074674 

4 

2.88639585 

3*09755766 

8 

2*36734857 

2.50933650 

16 

2*01795589 

2*11363367 

32 

1 *78141625 

1*84629005 

64 

1*62006566 

1 *66438962 

128 

1.50917003 

1*53967893 

256 

1*43244246 

1 *45357776 

512 

1.37906412 

1  .39378248 

1024 

1*34176981 

1.35206123 

2048 

1 *31562790 

1*32284604 

4096 

1*29725887 

1.30233301 

8192 

1*28432858 

1.28790149 

lE-3 

lE-4 

3*71692219 

4*29193205 

2.92459903 

3*31372579 

2*39281962 

2*65432267  < 

2*03544098 

2*21134522 

1*79362769 

1*91266565 

1*62866385 

1*7098487?  ! 

1 .51524477 

1.57104117 

1.43673968 

1*47534630 

1.38210498 

1*40896493 

1.34392160 

1*36268942 

1*31715039 

1*33030674  1 

1*29833595 

1*30758095 

1*28509047 

1.29159844 

1*27575385 

1 *28034098 

lE-7 

lE-8 

5.67769243 

6,06970852 

4.25904998 

4*52806135 

3.29282208 

3*47544423 

2.64073862 

2.76376208 

2*20209577 

2.28487698 

1 .90615996 

1*96210527 

1.70520835 

1*74328423 

1*567  1937 

1.59383081 

1*47297026 

1.49100181 

1*40726893 

1.41979378 

1 *36148146 

1.37022180 

1*32944798 

1*33556910 

1*30697131 

1.31126956 

1*29116614 

1.29419029 
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Figure  1.  Required  Input  S/N  for 


1 


LOG 

Figure  2.  Required  Input  S/N  for  P, 
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Figure  5.  Required  Input  S/N  for  Pf,=  .999 


TR  7117 


The  results  in  figures  1  through  5  only  cover  a  selected  set  of  detection 
and  false  alarm  probability  values.  A  more  complete  description  is  afforded 
by  the  receiver  operating  characteristics,  namely  detection  probability  vs. 
false  alarm  probability,  with  signal-to-noise  ratio  as  a  parameter.  In 
figures  6  through  19  are  given  these  operating  characteristics  for 

M  =  1,  2,  4,  8,  16,  32,  64,  128,  256,  512,  1024,  2048,  4096,  8192,  (33) 

respectively.  The  false  alarm  probability  covers  the  range  10“^®  to  .5, 
while  the  detection  probability  covers  10"^®  to  .999.  Both  abscissa  and 
ordinate  in  these  figures  employ  the  inverse  function  to  the  Gaussian 
cumulative  distribution  function!  defined  in  (19);  thus,  a  truly  Gaussian 
random  variable  would  plot  as  a  series  of  equally  spaced  parallel  straight 
lines  (with  parameter  a).  Observe  that  the  curves  are  neurly  equally  spaced 
with  parameter  a,  except  for  very  small  a,  where  the  nonlinear  envelope 
operation  causes  small  signal  suppression  and  a  crowding  together  of  the 
curves. 

If  the  decision  variable  x  is  presumed  Gaussian,  and  the  operating 
characteristics  overlayed  on  the  exact  results  in  figures  6-19,  it  is  found 
that  the  two  sets  of  curves  for  11*8192  are  virtually  identical  in  the  range  of 
Pp^  and  pQ  plotted.  However,  for  M*16,  the  Gaussian  approximation  is 
somewhat  optimistic;  for  example,  the  exact  curve  for  a=2.75  is  well- 
approximated  by  the  Gaussian  approach  for  a=2.62.  For  small  M,  the  Gaussian 
approximation  is  overly  optimistic  for  small  Pp^;  however,  the  two  sets 
cross  near  Pp^=.5,  which  is  not  a  practical  range  of  interest  anyway. 
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lE-10  lE-7  lE-4  lE-3  lE-2  lE-1  .5 


PROBABILITY  OF  FALSE  ALARM  PFR 


Figure  6.  Receiver  Operating  Characteristics  for  M=1 
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PROBABILITY  OF  FALSE  ALARM  PFA 


Figure  7.  Receiver  Operating  Characteristics  for  M=2 
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PROBABILITY  OF  FALSE  ALARM  PFA 


Figure  8.  Receiver  Operating  Characteristics  for  M=4 
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Figure  9.  Receiver  Operating  Characteristics  for  M=8 
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Figure  11.  Receiver  Operating  Characteristics  for  M*32 
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Figure  12.  Receiver  Operating  Characteristics  for  M=64 
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PROBABILITY  OF  FALSE  ALARM  PFA 


Figure  13.  Receiver  Operating  Characteristics  for  M=128 
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Figure  15.  Receiver  Operating  Characteristics  for  M»512 
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Figure  17.  Receiver  Operating  Characteristics  for  M«2048 
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PROBABILITY  OF  FALSE  ALARM  PFA 

Figure  18.  Receiver  Operating  Characteristics  for  M=4096 
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SUMMARY 

A  method  for  exact  evaluation  of  th  exceedance  distribution  function,  of 
a  linear  sum  of  M  envelopes  of  a  narrowband  Gaussian  process  and  sinewave,  has 
been  utilized  to  determine  the  receiver  operating  characteristics  for  a  wide 
range  of  values  of  M  and  signal-to-noise  ratio.  Also,  the  required  input 
signal-to-noise  atio  vs.  M  has  been  determined  for  a  selected  set  of  false 
alarm  and  detection  probabilities.  Programs  are  also  supplied  by  which  other 
values  of  the  various  parameters  can  be  investigated  by  the  user. 

Agreement  between  the  current  results  and  those  in  [1,2]  is  very  good 
over  the  range  of  common  values  plotted.  For  M  larger  than  8192,  the 
approximation  given  in  (27)  and  (28)  is  recommended,  since  the  summation 
variable  is  then  well  represented  by  a  Gaussian  random  variable. 
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APPENDIX  A.  DERIVATION  OF  RICE  CHARACTERISTIC  FUNCTION 


The  normalized  probability  density  function  of  a  Rice  random  variable  was 
given  in  (2)  as 


Pg{u)  =  u  exp 


(-4-) 


Ijj{ou)  for  u  >  0 


(A-l) 


The  corresponding  characteristic  function  is 


■feO  "M  2  2\ 

exp(ifu)  Pg(u)  =  Jdu  u  exp  ^i|u  -  -  Iq(ou)  = 
=  exp(-r)  'S  fdu  exp( i ju-u^/2)  , 

in'.r  < 


(A-2) 


where  we  have  expanded  I^  in  a  power  series  [5,  8.447  1]  and  defined  power 
signal-to-noise  ratio 


r  =  a^/2  . 


(A-3) 


(If  desired,  a  power  series  in  J  could  be  developed  by  expanding  exp(i?u)  in  a 
power  series  instead  of  1^.) 


We  define 


^n^^J  =  n  —2  exp(ifu  -  u^ 


and  get  the  characteristic  function  series 


12)  for  n  >  0  ,  (A-4) 


fgf )  =  «p(-r)  ^  r"  C^{5)  . 


(A-5) 


In  order  to  get  a  recurrence  on  C^(f),  we  also  define 


•o 

=  Jdw  w*^  exp(ifw  -  w^/2}  for  k  ^  0  > 


(A-6) 
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for  then 


C,(f) 


2"(n!)^ 


By  integrating  by  parts  on  (A-6),  there  follows 


{A-7) 


^  1  ^  •  (A-8) 

This  recurrence  can  be  started  with  [5,  3.896  3f4] 

Bq  =  exp(-f  /2)j|^+  |^J  .  (A-9} 

By  looking  at  three  adjacent  terms  of  recurrence  (A-8),  we  can  generate 
the  alternative  recurrence 


B^  =  (2k-3-/)B^_2  -  (k-2)(k-3)B^_4  .  (A-10) 

By  means  of  (A-7),  this  translates  into 


C 


n 


for  n  >  2 


(A-11) 


Starting  values  are  (via  manipulation  of  hypergeometric  series  and  Kummer's 
transformation)  expressable  as 


Cq  =  exp(-J^/2)  2*  2*  f")  *  ’ 

Cj  =  expi-fiz)  |;  |:  (3-5^)-fj.  (A-12) 

Each  of  the  series  for  consists  of  terms  of  the  same  polarity,  except 
for  one  term,  and  are  therefore  useful  for  obtaining  very  accurate  initial 
values.  Cq  is  the  characteristic  function  of  the  Rayleigh  probability 

A-2 
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density  function.  Relations  (A-11)-(A-12)  constitute  recurrences  on  both  the 
real  and  imaginary  parts  of  C^. 

It  was  found  that  the  terms  exp(-r}  r"^  in  (A-5}  became  very  large  for 
large  n,  while  the  terms  became  very  small.  In  order  to  avoid 

overflow  and  underflow,  we  defined  the  total  term 

A„  .  exp{-r)  r"  C„(f)  .  (A-13) 

Reference  to  (A-11)  readily  yields  the  recurrence  on  A^,  and  (A-12) 
furnishes  corresponding  obvious  starting  values  for  Aq  and  A^. 
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APPENDIX  B.  DESCRIPTION  OF  PROGRAMS  AND  LISTINGS 


Overview 


Information  obtained  via  evaluation  of  the  Rice  characteristic  function 
may  be  displayed  in  three  formats. 

FORMAT  1:  Display  PD  vs.  PFA 

The  user  defines  the  number  of  samples  M  and  the  range  of  values  for 
alpha,  a  voltage  signal-to-noise  ratio  measure.  An  algorithm  then  utilizes 
the  Rice  characteristic  function  for  alpha=0  and  for  the  alphas  specified  by 
the  user.  This  results  in  the  production  of  a  threshold  vs.  PFA  and  M 
{alpha=0)  and  threshold  vs.  PD  and  M  (alpha>0)  tables.  These  two  tables  are 
stored  on  an  output  file.  For  each  user-defined  M,  a  plot  routine  displays  PD 
vs.  PFA  for  the  set  of  user-defined  alphas. 

FORMAT  2:  Display  SNR  vs  M 

The  user  supplies  the  input  which  specifies  a  PD.  The  algorithm  then 
solves  for  the  threshold  values  corresponding  to  PFA=10**(-IPFA) , 

{IPFA=1, . . ,8)  and  M=2**IM,  ( IM=0, . . . ,13)  and  alpha=0.  A  root  finding 
technique  is  then  employed  to  solve  for  the  SNR  defined  by  a  threshold  value 
and  user-defined  PD.  An  SNR  is  found  for  each  threshold  value.  The  results 
are  stored  in  an  output  file.  A  plot  routine  displays  the  required  SNR  vs.  M 
for  PFA=10**(-IPFA),  ( IPFA=1,2, . . . ,8) . 

FORMAT  3:  Print  SNR 

The  user  specifies  a  value  for  PD,  PFA,  M,  The  program  solves  for  the 
threshold  corresponding  to  PFA  and  M.  A  root  finding  technique  is  then 
employed  to  determine  the  SNR  corresponding  to  this  threshold  and  user-defined 
PO  and  M.  The  results  are  printed. 
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Description  of  Input 


Inputs  to  the  program  consist  of  cards  which  either  specify  values 
(PARAMETER  CAROS),  activate  the  reading  of  tabularized  values  (TABLES),  assign 
files  (FILE  NAME  CARDS),  process  data  (COMMAND  CAROS),  or  specify  a  plot 
device  (PLOT  DEVICE  CAROS).  The  basic  format  of  a  card  is 

CARO  NAME  =  value  units 

where  CARD  NAME  is  an  alphanumeric  expression  from  Tables  2-6.  The 
alphanumeric  must  begin  in  column  1,  value  is  a  floating  point  or  integer 
number,  and  units  is  an  alphanumeric. 

Parameter  cards,  file  names,  and  tables  constitute  the  data  upon  which 
commands  operate.  If  two  cards  with  the  same  name  specify  different  data, 
then  the  last  entry  overrides  the  other. 

For  the  programmers  convenience,  FORTRAN  variable  names  associated  with 
file  names  or  parameters  may  be  located  in  the  Tables  2  through  6.  Since 
input  and  values  stored  represent  the  same  physical  quantity,  it  is  convenient 
to  refer  to  both  in  this  paper  by  the  same  variable  name.  The  convention 
adopted  is  to  express  the  variable  by  the  lower  case  letters  and  reserve  upper 
case  letters  for  constants. 

Parameter  Cards 


Parameter  cards  are  used  to  specify  an  axis  length  or  assign  a  range  of 
values  to  a  parameter.  These  cards  are  shown  in  Table  2.  For  example, 

NUMBER  OF  SAMPLES  MINIMUM  =  1. 

NUMBER  OF  SAMPLES  MAXIMUM  =  8192. 

NUMBER  OF  SAMPLES  FACTOR  =  2. 

implies  that  the  program  will  process  data  for  M=l, 2, 4,8, 16, .... ,4096,8192. 
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Table  Cards 


A  table  card  contains  the  values  that  are  to  be  assigned  to  a  variable. 
The  last  card  that  must  appear  in  a  table  is  an  EOF  card.  This  card 
terminates  the  reading  of  the  table.  Table  cards  exist  for  PD  and  PFA  only. 
A  list  of  the  table  cards  appears  in  Table  4.  For  example, 

PROBABILITY  OF  DETECTION  TABLE 

.5 

.7 

.99 

EOF 

This  table  assigns  values  of  .5,  .7,  .99  to  PO. 

Files  Cards 


A  file  card  allows  for  dynamic  assignment  of  all  mass  storage  files. 

This  is  accomplished  by  linking  internal  FORTRAN  unit  numbers  to  files  during 
execution.  The  file  card  is  shown  in  Table  4.  Two  of  the  three  algorithms 
use  files.  They  are 

Display  PD  vs  PFA  :  A  file  is  used  to  store  output. 

Display  SNR  vs  M  :  A  file  is  used  to  store  output. 

For  example. 


OUTPUT  FILE  =  PDFILE 

directs  the  output  of  a  program  to  a  file  called  PDFILE. 
Command  Cards 


Command  cards  are  u*,;ed  to  compute,  plot,  or  terminate  a  run  stream. 
Command  cards  are  given  in  Table  5. 


B-3 


TR  7117 


Plot  Device  Cards 


Plot  device  cards  direct  the  plot  output  to  either  a  TEKTRONIX,  FR80,  or 
a  CALCOMP  plotter.  The  cards  necessary  for  that  operation  are  shown  in 
Table  6. 

Examples  of  Output 


Example  1:  Display  PD  vs  PFA 

The  input  deck  for  the  first  example  appears  in  Table  7.  This  deck 
designates  that  PD  vs,  PFA  data  will  be  computed  for  M=1  and 
alpha=.5,1.0,1.5, . . . ,9.5.  The  output  is  stored  on  a  file  called  FILEl.  The 
plot  corresponding  to  the  data  is  shown  in  figure  6.  The  second  half  of  the 
run  stream  computes  PD  vs.  PFA  data  for  M=2  and  alpha=0. , .4, .8, . . . ,7.2.  The 
output  is  stored  in  FILE2.  The  plot  of  the  data  appears  in  figure  7. 

Example  2:  Display  SNR  vs.  M 

The  input  deck  for  the  second  example  appears  in  Table  8.  The  first  half 
of  the  input  deck  designates  that  the  SNR  vs.  M  plots  will  be  computed  for  a 
value  PD=.5.  The  output  is  displayed  in  figure  1.  The  parameter  cards 
specify  that  the  axis  will  be  scaled  as  follows:  -19  DB  (minimum),  13  DB 
(maximum),  2  DB  (increment),  and  5  inches  long  for  the  SNR  axis  and  6.86 
inches  long  for  the  number  of  samples  axis.  It  should  be  noted  that  the 
limits  for  the  number  of  samples  axis  are  predefined  by  the  program  to  be  1 
(minimum),  8192  (maximum),  2  (factor).  The  output  is  stored  in  a  file  called 
PDFILl.  The  second  half  of  the  run  stream  computes  SNR  vs.  M  for  a  value 
PD=,9.  The  axis  limits  for  SNR  were  changed  to  -17  DB  (minimum),  15  DB 
(maximum),  2  DB  (increment).  Alpha  curves  were  computed  for 
alpha=0. , .4, .8, . . . ,7.2.  This  output  is  stored  in  file  PDFIL2.  A  plot  of  this 
data  appears  in  figure  2. 

Example  3:  Print  SNR 

The  input  deck  for  the  third  example  appears  in  Table  9.  The  output 
appears  in  Table  10. 
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TABLE  2»  PARAMETER  CARDS 


INPUT  CARDS  UNITS 


SNR  AXIS  LENGTH  =  snraxs  IN 

SAMPLE  AXIS  LENGTH  ==  smpsxs  IN 

PD  AXIS  LENGTH  =  pdsxs  IN 

PFA  AXIS  LENGTH  =  pfasxs  IN 

SNR  MINIMUM  =  snrmin  DB 

SNR  MAXIMUM  =  snrmsx  DB 

SNR  INCREMENT  =  snrinc  DB 

ALPHA  MINIMUM  ==  slpinin 
ALPHA  MAXIMUM  =  alf>ma>t 
ALPHA  INCREMENT  =  alpine 


NUMBER  OF  SAMPLES  MINIMUM  =  smpmin 
NUMBER  OF  SAMPLES  MAXIMUM  =  smpmax 
NUMBER  OF  SAMPLES  FACTOR  =  smpfet 


TABLE  3.  TABLE  CARDS 


INPUT  CARDS  VARIABLE 


PROBABILITY  OF  DETECTION  TABLE  PD 

PROBABILITY  OF  FALSE  ALARM  TABLE  PFA 


TABLE  4»  FILE  CARDS 


INPUT  CARDS 


OUTPUT  FILE  =  name 


TABLE  5.  COMMAND  CARDS 


INPUT  CARDS 


RUN  MAIN 

COMPUTE  PD  VS  PFA 
COMPUTE  SNR  VS  M 
PLOT  PD  VS  PFA 
PLOT  SNR  VS  M 
END 
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TABLE  6,  PLOT  DEVICE  CARDS 


INPUT  CARDS 


OPTIONS 


BAUD  RATE  =  960, 

PLOT  DEVICE  =  device  FR80 » TEKTRO » CALCOMP 

RESET  PLOT  DEVICE 


TABLE  7,  SAHPLE  INPUT  DECK  FOR  PD  VS  PFA 


RUN  MAIN 

BAUD  RATE  =  960. 

PLOT  DEVICE  =  TEKTRO 

RESET  PLOT  DEVICE 

PD  AXIS  LENGTH  =  6.86  IN 

PFA  AXIS  LENGTH  =  5.  IN 

OUTPUT  FILE  =  FILEl 

NUMBER  OF  SAMPLES  MINIMUM  «  1 

ALPHA  MINIMUM  =  .5 

ALPHA  MAXIMUM  «  9.5 

ALPHA  INCREMENT  =  .5 

COMPUTE  PD  VS  PFA 

PLOT  PD  VS  PFA 

OUTPUT  FILE  =  F1LE2 

NUMBER  OF  SAMPLES  MINIMUM  =  2 

ALPHA  MINIMUM  -  0, 

ALPHA  MAXIMUM  =  7.2 
ALPHA  INCREMENT  =  .4 
COMPUTE  PD  VS  PFA 
PLOT  PD  VS  PFA 
END 
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TABLE  8.  SAMPLE  INPUT  DECK  FOR  SNR  vs  M 

RUN  MAIN 

BAUD  RATE  =  960, 

TEMPORARY  FILE  =  FALSE 

PLOT  DEVICE  TEKTRO 

RESET  PLOT  DEVICE 

OUTPUT  FILE  =  PDFILl 

SNR  MINIMUM  ==  -19,  DB 

SNR  MAXIMUM  =  13,  DB 

SNR  INCREMENT  =  2 ,  DB 

SNR  AXIS  LENGTH  =  5,  IN 

SAMPLE  AXIS  LENGTH  •=  6.86  IN 

PROBABILITY  OF  DETECTION  TABLE 

,5 

EOF 

COMPUTE  SNR  VS  M 

PLOT  SNR  VS  M 

OUTPUT  FILE  :=  PDFIL2 

SNR  MINIMUM  -  -17.  DB 

SNR  MAXIMUM  =:=  15,  DB 

SNR  INCREMENT  =  2 ,  DB 

PROBABILITY  OF  DETECTION  TABLE 

,9 

EOF 

COMPUTE  SNR  VS  M 
PLOT  SNR  VS  M 
END 


TABLE  9,  SAMPLE  INPUT  DECK  FOR  PRINTING  SNR 


RUN  MAIN 

PROBABILITY  OF  DETECTION  TABLE 

,5 

,9 

EOF 

PROBABILITY  OF  FALSE  ALARM  TABLE 

,1 

,001 

EOF 

NUMBER  OF  SAMPLES  MINIMUM  =  1, 
NUMBER  OF  SAMPLES  MAXIMUM  =  2048, 
NUMBER  OF  SAMPLES  FACTOR  =  2. 
PRINT  SNR 
END 
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Listing  of  Program 

This  section  contains  a  listing  of  three  master  programs  and  associated 
subroutines.  Subroutines  which  read  input  and  plot  the  output  have  been 
omitted.  Table  11  contains  a  list  of  the  subroutine  names  and  a  brief 
description  of  the  pertinent  subroutines. 
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NAME 


CMPDVA 

CMPSVS 

PRTSNFJ 

FFT 

RDC 

FNPD 

FNPF 

FNFll 

RICE 

FNIPHI 

DIST 
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TABLE  11.  DESCRIPTION  OF  SUBROUTINES 
DESCRIPTION 


MASTER  PROGRAM  FOR  COMPUTING  PD  VS  PFA 
MASTER  PROGRAM  FOR  COMPUTING  SNR  VS  M 
MASTER  PROGRAM  FOR  COMPUTING  AND  PRINTING  SNR 
COMPUTES  THE  FAST  FOURIER  TRANSFORM  OF  A  FUNCTION 
COMPUTES  AN  APPROXIMATE  S/N  FOR  A  GIVEN  PD»  PFA»  M 
(SEE  REF  7  ) 

COMPUTES  THE  PROBABILITY  OF  DETECTION  FOR  A  GIVEN 
M»  S/Hf  AND  THRESHOLD 

COMPUTES  THE  PROBABILITY  OF  FALSE  ALARM  FOR  A  GIVEN 
M  AND  THRESHOLD 

COMPUTES  THE  CONFLUENT  HYPERGEOMETRIC  FUNCTION 
COMPUTES  THE  CHARACTERISTIC  FUNCTION  OF  A  RICE 
VARIATE 

COMPUTES  THE  INVERSE  OF  THE  CUMULATIVE  GAUSSIAN 
DISTRIBUTION 

COMPUTES  THE  EXCEEDANCE  DISTRIBUTION  FUNCTION  FOR 
A  GIVEN  M  AND  S/N 
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SUBROUTINE  FFT(N»X»Y) 

IMPLICIT  DOUBLE  PRECISION  <A-H»0-Z) 

DIMENSION  C(0J256) »X(0: 1023) »Y<OJ 1023) »L(0;9) 
DATA  PI/3»14159265358979324D0/ 

T=2.D0*P1/N 

Jl=N/4 

DO  100  J*0.J1 
C( J)=DCOS<T*DFLOTJ< J)  ) 

100  CONTINUE 

Nl=N/4 

N2=N1+1 

N3=N2+1 

N4=N3+N1 

L2=JIDINT<1 ♦4427DO*DLOG(DFLOTJ(N) )+.5D0) 

DO  600  Il='lfL2 
I2='2**<L2-I1  ) 

I3=2D0*I2 

I4=N/I3 

DO  500  I5=1»I2 
I6=I4»(I5-1)+1 
IF<  I6»LE,N2  )  GO  TO  350 
V6=-C<N4-I6-1 ) 

V7=-C< I6-N1-1 > 

60  TO  375 
35P  U6=C<I6“1) 

V7=-C<N3-I6-1) 

375  L3-N-I3 

DO  400  I7=0*L3»I3 

18=17+15 

19=18+12 

V8=X(I8-1)~X<I9-1) 

V9=Y(I8-1)-Y(I9-1) 

X(I8-1 )=X( 18-1 )+X( 19-1 ) 

Y< 18-1 )=Y <18-1 )+Y< 19-1 ) 

X<19-1 )=V6*V8-V7*V9 
Y(I9-1 )=V6*V9+V7*U8 
400  CONTINUE 
500  CONTINUE 
600  CONTINUE 


I1=L2+1 

DO  700  I2=l»10 
L( I2-l)=l »D0 

IF<  I2*GT»L2  )  GO  TO  700 
L(I2-1 )=2**(I1-I2) 

700  CONTINUE 
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900 

1000 

1100 

1200 

1300 

1400 

1500 

1600 

1700 

1800 

1900 


IC0=L<0) 

IC1=L(1> 

IC2»L<2> 

IC3=:L(3) 

IC4=L(4) 

IC5=L(5) 

IC6=L<6) 

IC7=L<7) 

IC8=L(8) 

IC9==L<9) 


K=1 

DO  1900  Il’sl»IC9 
DO  1800  12=11, IC8»IC9 
DO  1700  I3=I2»IC7,IC8 
DO  1600  14=13, IC6,IC7 
DO  1500  15=14, ICS, IC6 
DO  1400  16=15, IC4, ICS 
DO  1300  17=16, IC3,IC4 
DO  1200  18=17, IC2,IC3 
DO  1100  19=18, IC1,IC2 
DO  1000  110=19, ICO, ICl 
J=I10 

IF<  K,GT.J  )  GO  TO  900 
A=X(K“1 ) 

X<K-1)=X< J~1 ) 

X( J-1 )«A 
A=Y<K--1 ) 

Y(K-1)=Y( J-1) 

Y< J-1 )=A 

K=K  +  1 

CONTINUE 

CONTINUE 

CONTINUE 

CONTINUE 

CONTINUE 

CONTINUE 

CONTINUE 

CONTINUE 

CONTINUE 

CONTINUE 

RETURN 

END 
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SUBROUTINE  FNPD ( ALPHA » V » AM » AL » AD » ABS » PD ) 
IMPLICIT  DOUBLE  PRECISION  <A~H»0-Z) 

DATA  PI/3»14159265358979324D0/ 

SNR= .  5D0)|tALPHA*ALPHA 

CALL  FNFll(l»5D0»l,D0»SNRfFll) 

FAC=DSQRT<  » 5D0*P I ) *EXP < -SNR > *F1 1 

AMUY=AM*FAC+ABS 

AM2=-AM/2»D0 

VD=V*AD 

EXC=.5#AD*AMUY 
NS1= JIDINT<AL/AD) 

DO  100  NS=1»NS1 
XI=AD*NS 

CALL  RICE(XI,SNR»FR»FI) 

A=DATAN2(FI»FR) 

FYI  =  DSIN<AM*A+ABS1tXI)*<FR)|tFR  +  FI*FI)<c*AM2 
ADD-FYI»DCOS<VD*DFLOTJ(NS> )/DFLOTJ(NS> 
EXC=EXC+ADD 
100  CONTINUE 

PD=2*D0#EXC/PI 

RETURN 

END 


SUBROUTINE  FNPF< V» AM» AL» AD» ABS»PF) 
IMPLICIT  DOUBLE  PRECISION  <A-H»0-Z> 

DATA  PI/3»141592<5.5358979324D0/ 

FAC«DSQRT<  .SDOsKPI) 

AMUY«AM*FAC+ABS 

AM2=AM/2.D0 

VD=V»AD 

EXC= .5*AD#AMUY 
NS1=JIDINT(AL/AD) 

DO  100  NS=1»NS1 
XI=AD»NS 
X2=,5D0*XI*XI 
E=EXP<-X2) 

CALL  FNF11(-*5D0»  »5D0»X2!.F11  > 

FR=E*F11 

FI=E»FAC*XI 

A=:DATAN2<FItFR) 

FYI::--DSIN(AM*A  +  ABS*XI  )*<FR*FR+FI*FI  >#ittAM2 
ADD=FYI*DCOS<UD*DFLOTJ(NS) )/DFLOTJ(NS) 
EXC=EXC+ADD 
100  CONTINUE 

PF=2.D0*EXC/PI 

RETURN 

END 
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SUBROUTINE  RDC < AM » PF » PD» ALPHA ) 

IMPLICIT  DOUBLE  PRECISION  (A-H»0-Z) 

A=DLOG<  »62D0/PF) 

B=DLOG(Pn/<l ►DO~PD)) 

FACT  =  6.2D0  +  4  * 54D0/DSQRT < AM+ . 4  4DO ) 

SNRDB=-5,D0#DL0G10<AM)  +  DLOGl 0 ( A+ » 12D0*A*B+1 » 7D0*B > *FACT 
ALPHA=DSQRT(2*D0*10^D0**<  »1D0*SNRDB) ) 

RETURN 

END 


SUBROUTINE  FNFl 1 < A » B » X , FI 1 ) 

IMPLICIT  DOUBLE  PRECISION  (A-H^O-Z) 

Fll=-1  »DO 
T^l *DO 

DO  100  K^=l»300 
U==K-1 

T  =  T*< A  +  U>*X/<  <B  +  U>#K) 

F11=F11+T 

IF<  DABS<T) .LE.DABSCFll )»1 .D- 18  )  GO  TO  200 

100  CONTINUE 
PRINT  101 

101  F0RMAT(2X, '300  TERMS  IN  FNFll') 

200  CONTINUE 

RETURN 

END 


SUBROUTINE  FNIPHI <X»PHI ) 

IMPLICIT  DOUBLE  PRECISION  <A-HfO-Z) 

100  Y=DMAX1 (X, 1 ,D-12) 

Y=DMIN1<Y»1 »D0-1 »D-12) 

D==X-.5D0 

IF(  DABS<D>.GT»  .OIDO  )  GO  TO  250 

PHI  =  2^50662827463D0,.D*<1  .D0+D*D*1  »04719755120D0> 

GO  TO  300 
250  PHI=Y 

IF<  Y.GT.  .SDO  )  rHI=»5D0-<Y-»5D0) 
PHI=DSQRT(-2»D0*DL0G<PHI) > 

T=1 »B0+PHI»(1 »432788D0+PHI*< , 1 89269D0+PHI ♦ ♦ 001 308D0 ) ) 
PHI~PHI-(2 .515517D0+PHI*< ► 802853D0+PHI * » 01 0328D0 ) )/T 
IF<  Y.LT,  .5D0  )  PHI=-PHI 
300  RETURN 
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SUBROUTINE  BIST < AM » ALPHA , MF » X r Y  ) 
IMPLICIT  noUBLE  PRECISION  (A-H»0-Z) 
DIMENSION  X<0:1023>»  Y(0:io;'3) 
COMMON  /PDVPF/AL »AD»ABS 
DATA  PI/3,14159265358979324D0/ 


SNR=.5D0*ALPHA*ALPHA 

CALL  FNFll < 1 ,5D0* 1 .DO»SNR,Fl 1  ) 

AMU  =  DSQRT< , 5D0*PI ) ♦DEXP ( -SNR  )  *F1 1 

AMUS=AM*AMU+ABS 

AM2=AM/2.D0 


DO  100  I=0»1023 
X( I)=O^DO 
Y< I)=0»D0 
100  CONTINUE 

X<0)=»5D0*AMUS»AD 
NS1=JIDINT ( AL/AD) 

DO  1000  NS  =  l!-NSl 
XI=AD)|tNS 

CALL  RICE<XI»SNR»U>U) 

T=DATAN2(U>U) 

FI=DSIN< AM*T+ABS*XI )*(U*U+V*0)»*AM2 
MS=JMDD<NSrMF> 

X<MS) =X<MS)+FI/NS 
1000  CONTINUE 

CALL  rFT(MFfX>Y) 


FAC=  2 .DO/PI 

KS1=MF/2»D0 

DO  2000  KS^=0»KS1 

T=X(KS)*FAC 

X(KS)=1 »DO-T 

Y{KS)=T 

2000  CONTINUE 

RETURN 

END 
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SUBROUTINE  R I CE ( X » SNR > FR » F I > 
IMPLICIT  DOUBLE  PRECISION  (A-H»0-Z) 
DATA  PI/3, 14159265358979324D0/ 


X2=,5D01iX*X 

E=--DEXP<-X2~SNR) 

CALL  FNF11(-,5D0» ,5D0»X2»F11) 

AOR--=E*Fll 

A0I=^E#DSQRT<  .5D0#PI  )*X 

CALL  FNFll <~1 ,5D0» .5D0*X2»F11 ) 

ANR--=E»SNR*F1 1 
ANI=SNR*< 1 ,5D0-X2)»A0I 
FR=AOR+ANR 
FI=AOI+ANI 

BR=DMAX1 (DABS (AOR) » DABS (FR> ) 

BI=DMAX1 <DABS( AOI) »DABS(FI)  ) 

T= .5D0+X2 

SNR2=SNR*»2 
DO  100  N--=2»200 
F0=N**2 

F1=SNR*(N+N-T)/F0 

F2  =  SNR2*(N-.5D0)/<  <N-1 )*F0) 

R=F1)KANR-F2*A0R 

U-F1»ANI-F2#A0I 

AOR- ANR 

AOI=ANI 

ANR=R 

ANI  =  V 

FR=FR+R 

FI=FI+V 

BR  =  DMAX1  <BRi-DABS(FR)  ) 

BI=DMAX1 <BI»DABS(FI  )  ) 

IF<  DABS< V) ,LE ,5,D-19*DABS<FI )  ,AND,  DABS ( R ) . LE . 5 . D- 1 9*DABS ( FR > ) 
1  GO  TO  200 

100  CONTINUE 

PRINT  101 

101  F0RMAT<2Xf '200  TERMS  IN  RICE') 

200  DR  =  18,-DL0610(DABS<BR/FR)  ) 

DI =1 8, -DL0610( DABS (BI/FI ) ) 

RETURN 

END 
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SUBROUTINE  CMPDUA 
PARAMETER  MF=2**10 
PARAMETER  PBriNUM  =  18 
DOUBLE  PRECISION  AL , AD t ABS , BSA » AM » ALPHA r ALFA » X ( 0 t 1 023 ) » Y<0: 1023) 
PARAMETER  (NUMFIL=30> 

CHARACTER*6  FILES ( NUMFIL ) 

COMMON  /FILEC/FILES 
CHARACTER*6  PBDNAM 
EQUIVALENCE 

1  (PBDNAM»FILES< 18)  ) 

PARAMETER  <NUMPAR=200> 

COMMON  /PARAMC/PARAMS<NUMPAR) 

EQUIVALENCE 

1  <SMPMIN»PARAMS< 187) ) » 

1  (SNMIN»PARAMS< 184) ) »  < SNMAX » PARAMS < 1 85  )  )  ,  < SNDEL » PARAMS ( 186 ) ) 
COMMON/PDVPF/AL»AD»ABS 
DOUBLE  PRECISION  PI 
DATA  PI/3»14159265358979324D0/ 


OPEN  THE  FILE 

CALL  OPNFIL<PBDNUM»PBDNAM) 
COMPUTE  THE  NUMBER  OF  SNR  CURVES 
NSN=<SNMAX-SNMIN)/SNDEL  4  1 


STORE  HEADER  INFO 

URITE(PBDNUH)  SMPMINf SNMINr SNMAX^ SNDEL » NSN 
AM  =  SMPMIN 

AL  =  DMINl <9.D0» 17»D0/DSQRT(AM) ) 

AD  =  . 12D0/DSQRT<AM) 

BSA  =  --DSQRT(PI/2»D0)»AM  +  6  ►  DO*DSQRT  <  AM  ) 
ABS  =  DMINl <0»D0»BSA) 

COMPUTE  SNR  VS  PFA 
ALFA=0»D0 

CALL  i;iIST(AM»  ALFA»MF»X»Y) 

STORE  THE  SNR  VS  PD 
WRITE(PBDNUM)  < Y < I ) » I =0 » 512 ) 

DO  1000  ISN=rl,NSN 

SNR=  SNMIN  +  SNDEL»< ISN-1 ) 

ALPHA  =  SNR 

CALL  DIST( AM» ALPHArMFfXrY) 

STORE  THE  SNR  VS  PD 
WRITE(PBDNUM)  < Y < I > t I =0 » 51 2 ) 

1000  CONTINUE 

2000  CONTINUE 


RETURN 

END 
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SUBROUTINE  PRTSNR 

IMPLICIT  DOUBLE  PRECISION  <A-H»0-Z) 
DIMENSION  PFA(IO) »PD(10) »y(14»8) »SNR(14»8) 
DATA  PI/3.14159265358979324D0/ 

REAL  SMPMIN»SMPMAX»SMPFCT,PARAMS 
PARAMETER  NUMPAR=200 
COMMON/PARAMC/PARAMS<NUMPAR) 

EQUIVALENCE 

1  <SMPMIN»PARAMS(187) ) »  < SMPMAX » PARAMS ( 188) ) » 
COMMON/PDPF/NPD»NPFArPn»PFA 


MMAX=AL0G10<SMPMAX/SMPMIN)/AL0D10<SMPFCT)  + 


Fl=DSaRT< .5D0»PI) 

F2=DSQRT<2*D0-,5D0*PI) 

DO  1000  IM=1»MMAX 
AM=SMPMIN*SMPFCTt*< IM-1 ) 

AL  =  DMINl (9»D0» 17.D0/nSQRT(AM) ) 

AD  =  , 12D0/DS0RT(AM) 

BSA  =  ~DSQRT<PI/2.D0))|!AM  +  A  »  D0*DSQRT  ( AM  > 
ABS  =  DMINl <0»D0»BSA) 

AMU=F1*AM 

SIG--*F2*DSQRT<AM) 

DO  900  IPF=1^NPFA 
PF=PFA(IPF) 

IF<  AM.GT,  l.DO  )  GO  TO  250 
VN=DSQRT<-2»»DL0G(PF) ) 

GO  TO  750 

250  CALL  FNIPHI <PF»YF) 

V1=AMU  -SID*YF+ABS 

IF<  IPF.GT.l  )  V1=DMAX1<V1.-.VN) 

V2=V1+,5D0 

IF<  V1.NE»VN  )  GO  TO  300 

P1=PN 

GO  TO  325 

300  CALL  FNPF<Vl»AM»AL»ADf ABS»P1) 

325  CALL  FNPF<V2»AM»AL»AD»ABS»P2) 

IF(  DABS<P1-PF) ►LT.DABS<P2-PF>  )  60  TO  350 
V0=V1 
P0=P1 
VN  =  V2 
PN=F2 
GO  TO  400 
350  V0=V2 

P0=P2 
VN  =  gi 
PN=P1 

400  CALL  FNIPHI (POtYO) 

GO  TO  550 

500  CALL  FNPF(VN»AM»AL»AD»ABS»PN) 

550  CALL  FNIPHKPNfYN) 

IF<  DABS<PN-PF) .LE. 1D-9»PF  >  GO  TO  750 
T«{gO*(YN-YF)+VN*<YF-YO) )/(YN-YO> 


<SMPFCT»PARAMS 


1 
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VO=VN 

YO=YN 

VN=T 

GO  TO  500 
750  V<IH»IPF>=VN 
900  CONTINUE 
1000  CONTINUE 


DO  4000  IPD=1»NPD 


CALL  FNIPHI<Pn< IPD) »YD> 

DO  3000  IM=1»MMAX 
AM=SHPHINi|(SMPFCT»*  ( IM-1 ) 

AL  =  DMINl <9*D0»17.D0/DSQRT<AM) ) 

AD  =  . 12DO/DSORT(AM) 

BSA  =  -DSQRT<PI/2.D0)*AM  +  6 » DO*DSQRT ( AM ) 

ABS  =  DMINl <0»D0»BSA) 

DO  2900  IPF=1»NPFA 
PF=PFACIPF) 

CALL  RDC<AM»PF*PD<IPD) »A1 > 

A2=A1*1 .OIDO 
VV=V(IM»IPF> 

CALL  FNPD< A1 » VVf AMf AL>AD^ ABS^Pl ) 

CALL  FNPD(A2»VV»AMf AL»AD»ABS»P2> 

IF(  DABS<P1-PD<IPD) ) ♦LT,DABS(P2~PD<IPD) >  )  GO  TO  2350 

A0=A1 

PO-Pl 

AN  =  A2 

PN  =  P2 

GO  TO  2400 
2350  A0=A2 

P0=P2 
AN  =  A1 
PN=P1 

2400  CALL  FNIPHI <PO»YO) 

GO  TO  2550 

2500  CALL  FNPD(AN»VVf AM»AL»AD»ABS»PN) 

2550  CALL  FNIPHI < PN » YN ) 

IF(  DABS<PN-PD<IPD) ) ,LE»1D“6*PD(IPD)  )  GO  TO  2750 
T=(A0*(YN-YD)+AN»( YD-YO) )/(YN-YO) 

AO=AN 
YO  =  YN 
AN  =  T 

GO  TO  2500 

2750  SNR<IM» IPF)=10**DLOG10< ,5D0tAN»AN> 

2900  CONTINUE 
3000  CONTINUE 
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DO  3200  IPF=1,NPFA 
PRINT  3001 
3001  F0RMAT(2</)) 

PRINT  3011^  PD<IPD>»PFA<IPF) 

3011  F0RHAT<2X» 'PD  = ' » F 1 0 » 3 f 5X » ' PFA  ='»D10»3) 
DO  3100  IH=1»MMAX 
M=SMPMIN*SMPFCT**< IM-1 ) 

PRINT  3021»  M»SNR<IM»IPF) 

3021  F0RMAT<2X»'M  = ' » 15 » 5X » ' SNR  ='»F7»2> 

3100  CONTINUE 
3200  CONTINUE 

4000  CONTINUE 


RETURN 

END 


SUBROUTINE  CMPSUS 

IMPLICIT  DOUBLE  PRECISION  (A-H»0-Z) 

PARAMETER  MMAX=14 

PARAMETER  NUMFIL=30»  PBDNUM=18 

CHARACTERi|t6  FILES<  NUMFIL  > 

COMMON/FILEC/FILES 
CHARACTEP»6  PBDNAM 
EQUIVALENCE  < PBDNAM » F I LES < 1 8 ) ) 

DIMENSION  PFA(IO)  fPD<10))-M(14»8)  rALPHA(14»8) 
DIMENSION  THRS<14»8) 

DATA  PI/3»14159265358979324D0/ 
COMMON/PDPF/NPD»NPFA»PD»PFA 


CALL  OPNFIL(PBDNUM»PBDNAM) 
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F1=DSQRT< ,5D0*PI ) 

F2=DSaRT(2.D0-.5D0*PI) 

DD  1000  IM===l)rMMAX 
AM=2.**(IM-1) 

AL  =  DMIN1<9*D0»17»D0/DSQRT<AM>> 

AD  .12D0/DSQRT(AM) 

BSA  =  -DSQRT<PI/2.D0)*AM  +  6 . D0*DSQRT ( AM ) 
ABS  =  DMINl <0»D0»BSA) 

AMU=F1*AM 

SIG=F2#DSQRT<AM) 

DO  900  IPF=--1»8 

PF  =  10,#*<-DFL0TJaPF)  ) 

IF<  AM.GT*  l.DO  )  GO  TO  250 
0N=DSQRT<-2.*DL0G<PF) ) 

GO  TO  750 

250  CALL  FNIPHI <PF»YF) 

V1=AMU-SIG*YF+ABS 

IF<  IPF»GT.l  >  V1=DMAX1<V1»VN) 

V2=V1+»5D0 

IF<  V1»NE*VN  )  GO  TO  300 

P1=PN 

GO  TO  325 

300  CALL  FNPF<V1»AM»AL»AD»ABS»P1  ) 

325  CALL  FNPF<V2»AM»AL>AD»ABS»P2> 

IF(  DABS<P1-PF> »LT*DABS(P2-PF>  )  GO  TO  350 
V0=V1 
P0=P1 
VN*V2 
PN=P2 
GO  TO  400 
350  00  =  02 

P0  =  P2 
0N  =  01 
PN=P1 

400  CALL  FNIPHI <PO»YO) 

GO  TO  550 

500  CALL  FNPF(ON» AM»ALf AD»ABS»PN) 

550  CALL  FNIPHI(PN»YN) 

IF<  DABS<PN"PF)  »LE*lD-9)|tPF  )  GO  TO  750 
T=<00»(YN-YF)+0N*<YF-Y0) )/(YN-YO) 

00=0N 
YO=YN 
ON  =  T 

GO  TO  500 
750  0<IM»IPF)=0N 

THRS( IM» IPF)=<ON-ABS>/AM 
900  CONTINUE 
1000  CONTINUE 
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2350 

2400 

500 

550 


750 

900 

3000 

4000 


WRITE(PBnNUM)  NPD r ( PD ( I ) » I > 1 0 ) 

DO  4000  IPD=1»NPD 


CALL  FNIPHI<FD<IPD)»YD> 

DO  3000  IM=--1»MMAX 
AM=2.D0**( IM-1 ) 

AL  =  DMINl <9»D0, 17 ►DO/DSQRT< AM) ) 

AD  =  . 12DO/DSORT< AM) 

BSA  =  -DSQRT<PI/2.D0)*AM  +  A » DO»DSQRT < AM ) 

ABS  =  DMIN1<0*D0»BSA) 

DO  2900  IPF=1,8 
PF=10.D0»*(-DFL0TJ<IPF)  ) 

CALL  RDC<AM»PF»PD< IPD) » A1 ) 

A2  =  A1)|C1  ►OIDO 
VV»V< IMf IPF) 

CALL  FNPD< A1 » VV»AM» AL» ADfABSfPl ) 

CALL  FNPD<A2»00»AM» AL.AD»ABS»P2) 

IF<  DABS<P1-PD<  IPD)  )  »LT»DABS{P2--PD<  IPD)  )  >  GO  TO  2350 

A0=A1 

P0=P1 

AN  =  A2 

PN  =  P2 

GO  TO  2400 

A0=A2 

P0=P2 

AN*A1 

PN«P1 

CALL  FNIPHKPOrYO) 

GO  TO  2550 

CALL  FNPD( AN»VO» AM»AL»AD»ABS»PN) 

CALL  FNIPHI(PN»YN) 

IF(  DABS<PN-PD< IPD) ) .LE »1D-6*PD( IPD)  )  GO  TO  2750 
T=< AO*(YN"YD)+AN*(YD-YO) )/( YN-YO) 

AO  =  AN 
YO  =  YN 
AN  =  T 

GO  TO  2500 
ALPHA<IM»IPF)=AN 
CONTINUE 
CONTINUE 


URITECPBDNUM)  (  ( ALPHA  <  IM  »  IPF  )  » IPF:=1  »  8  >  j  IM  =  1  »  MMAX  ) 
CONTINUE 


RETURN 

END 
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Resolution  of  Ambiguity 
For  Randomly 
Moving  Line  Array 


A.  H.  NuttaU 

ABSTRACT 

The  generalized  likelihood  ratio  detector,  for  deciding  between  the 
right-left  ambiguity  of  a  line  array  attempting  to  estimate  the  angle  of 
arrival  of  a  plane  wave,  is  derived.  Two  scenarios  are  considered,  the 
flrst  with  noisy  measured  antenna  angle,  the  second  with  noiseless 
antenna  angle  measurements.  The  detector  for  both  cases  is  a  cross- 
correlator  of  the  sample  ac  components  of  the  measured  antenna  and 
source  angle  waveforms. 
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INTRODUCTION 


A  line  array  Inherently  has  a  cone  of  ambiguity  in  its  response.  When 
the  array  lies  in  the  horizontal  plane,  and  a  source  is  located  in  that  same 
plane,  the  ambiguity  reduces  to  a  right-left  uncertainty,  which  cannot  be 
resolved  without  some  manuevering  on  the  part  of  the  source  or  array.  If  the 
line  array  is  moving  randomly,  unintentionally  or  uncontrollably,  this 
movement  can  serve  as  a  means  of  making  a  high  quality  decision  about  the 

source  direction,  if  the  array  angle,  as  well  as  the  source  angle  relative  to 
the  line  array,  are  measured. 


Figure  1.  Geometry  of  Line  Array  and  Source 

The  situation  of  interest  here  is  described  in  figure  1.  The  line  array 
is  being  towed  due  north;  however,  it  is  undergoing  rigid  bar  rotation  about 
this  direction  in  a  random  manner,  as  described  by  random  process  a(t),  which 
is  the  actual  antenna  angle  relative  to  the  towing  direction. 

The  actual  source  angle,  relative  to  the  line  array  end-fire  direction, 
is  s{t).  Furthermore,  the  actual  source  angle,  relative  to  the  towing 
direction,  is  ©,  an  unknown  constant;  it  is  presumed  that  ©  is  constant 
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throughout  the  observation  interval.  Reference  to  figure  1  reveals  th’at  these 
various  quantities  are  interrelated  according  to  the  alternatives 


a(t)  +  s(t)  for  hypothesis  1,  Hj, 
a(t)  -  s(t)  for  hypothesis  2, 


However,  it  is  unknown  which  hypothesis  is  correct;  nevertheless,  it  is 
desired  to  make  a  reliable  decision,  so  that  an  accurate  estimate  of  the 
source  direction  can  be  made.  From  (1),  observe  that  we  can  express 


which  will  be  needed  in  later  developments. 
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NOISY  MEASURED  ANTENNA  ANGLE 

In  this  section,  the  measured  antenna  angle  is  not  a(t)  as  desired,  but 
rather  is 


x(t)  =  a(t)  +  m(t)  ,  (3) 

where  m(t)  is  an  unavoidable  additive  noise  process.  Also  the  measured  source 
angle  is  not  s(t),  but  instead  is 

y(t)  =  s{t)  +  n(t)  ,  (4) 

where  n(t)  is  likewise  an  undesirable  additive  perturbation,  due  to  limited 
observation  time,  array  length,  ambient  noise,  etc.  The  three  random 
processes  a(t),  m(t),  n(t)  are  presumed  to  be  zero-mean  Gaussian  processes, 
independent  of  each  other. 

Combining  (2)-(4},  the  situation  is  as  follows:  the  available 
measurements  upon  which  a  decision  must  be  reached  are  the  two  waveforms 

x(t)  =  a(t)  +  m(t) 

y(t)  =  ©  -  a(t)  +  n(t) 

or 

x(t)  =  a(t)  +  m(t) 
y(t)  =  -©  +  a(t)  +  n 

On  the  basis  of  waveforms  x(t)  and  y(t),  what  is  the  best  decision  and  what  is 
the  corresponding  estimate  of  o? 


\ 


>  for  H 


1 


r 


(5A) 
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Derivation  of  Generalized  Likelihood  Ratio 


Let  A  be  the  time  sampling  increment  applied  to  measurement  waveforms 
x(t)  and  y(t);  assume  that  the  samples  of  the  three  processes  are 
statistically  independent  at  this  rate.  Denote 


\  =  x(kA)  for  1  £  k  <  K  , 
yk  =  y(kA)  for  1  £  k  £  K  , 


(6) 


Where  Ka  is  the  total  observation  time,  and  let  the  collections  of  samples  be 
denoted  by 

X  =  x^,  x^,  ...»  X|^,  Y  =  yp  y,^.  A  =  ap  a2,  ...,  a,^  .  (7) 


Tnen  for  a  fixed  A  and  a  hypothesized  value  for  the  source  angle,  the 
conditional  probability  density  function  under  Hp  of  the  total  set  of 
measurements  X,  Y,  is 


(X,  Y|©^ 


(8) 


where  the  normalized  Gaussian  probability  density  function  is 


^(t)  =  exp(-t^/2)  .  (9) 

Here  we  used  (5A)  and  the  Gaussian  character  of  processes  m(t)  and  n(t)  with 
standard  deviations  and  respectively. 

We  now  must  weight  (8)  by  the  Gaussian  probability  density  function  for 
process  a(t)  and  integrate  over  A,  to  determine  the  unconditional  probability 
density  function  of  X,  Y,  for  hypothesized  value  ©^.  Carrying  out  the 
integrals  and  simplifying  the  result,  we  obtain 
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Pl(x.  Y|»,)  -  (2.»,Vn  4'^) 


exp 


'^an  v  2  am  ,2  1  ^  , 

7^7  4’'"  ■  777  -  -777  A) 

2'>3‘’m  ^  ^'^3%  ^  Vii,°n  " 


(10) 


where  we  define 


f^am  =  ^  ^  »  ‘^an  “  -7  ^  *  *^3 

00  O  G 

a  m  a  n 


and  use  the  shorthand  notation 


1  ^  1  ^  1 
a  m  n 


(U) 


2=i.  (12) 


In  a  similar  fashion,  the  unconditional  probability  density  function  of  X,  Y 
under  H2,  for  hypothesized  value  o^,,  is  given  by 


P2(X.  y|p^)  =.  (2.c^o„<.„ 


-K 


*  exp 


Un  X 
.  2  ^ 


\  - 


2(Y7»h)^  *  -r^-2  |.>‘k(Xk*»h> 

^  ''3'’n>°n  ^  J 


(13) 


Now  if  were  known,  we  could  evaluate  the  likelihood  ratio  by  taking 
the  ratio  of  (10)  and  (13).  However,  we  must  resort  instead  to  a  generalized 
likelihood  ratio,  by  computing  the  two  values  of  that  maximize  (10)  and 
(13)  respectively,  and  then  taking  the  ratio  of  the  two  maxima  [1,  p.  92]. 
This  procedure  is  not  optimum  in  any  sense;  however,  it  often  leads  to 
physical  processors  that  perform  well. 


The  values  of  ©|^  that  maximize  (10)  and  (13)  are  given  respectively  by 
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^2 

®a  °m  ** 

1 

®2  “  ■  ■"  T  7  2  ^  ^2  ’ 

^  ‘’a  *  ■^m  ^ 


(14A) 


(148) 


These  results  have  a  reasonable  physical  interpretation;  From  (5A),  the  sum 
x(t)  +  y(t)  would  eliminate  the  random  process  a(t),  and  the  sample  mean  of 
the  sum  would  give  an  estimate  of  o  under  However,  m(t)  contaminates 

7  7  7 

the  a(t)  contribution  according  to  (3);  thus  the  scale  factor  +  o^)  in 

(14A)  indicates  how  trustworthy  the  sample  mean  of  x(t)  is.  The  noise  n(t)  in 
y{t)  is  unavoidable  but  is  partially  suppressed  by  the  inherent  averaging  of 
the  sample  mean  of  y(t).  A  similar  argument  holds  for  x(t)  -  y(t)  under  H2. 


The  logarithm  of  the  generalized  likelihood  ratio  is  (proportional  to) 


T  =  i  R_  G 
Z  3  m 


2  f„  ''H2) 

Pl(*.  ■ 


•  -  T  "am  "m  ^  *2)^  *  7  ^^kl^k  *  *2) 


*  7  Ram  4  ^(J-k  -  2^*k(j'k  '  »!> 


(15) 


where  we  used  (10)  and  (13)  with  and  ©2  substituted  for  e^,.  Now  let 

Sx  -  |*k-  =  2yk  .  R  •  Zvk  • 

Then  (15)  becomes,  upon  use  of  (14)  and  simplification  and  cancellation  of 
various  terms. 
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where 


^  ^  “ 


4  =  *k  -  K^xm 


for  1  <  k  <  K  , 


for  1  <  k  <  K  , 


(17A) 

(178) 


(18) 


are  defined  as  the  sample  ac  components  of  measurements  X  and  Y;  that  is,  the 
sample  means  are  subtracted  from  the  measurements. 

The  generalized  likelihood  ratio  test  in  (17)  says  to  cross-correlate  the 
sample  ac  components  of  both  measured  waveforms  and  to  compare  with  zero 
(assuming  and  H2  are  equally  likely  apriori).  That  is,  the  test  is 

K  «  Hp 

^  2  Xfcl'k  i  °  ■ 

k=l 

Observe  that  this  decision  rule  makes  no  use  of  the  variances  of  any  of  the 
processes  a(t),  m(t),  n(t),  although  this  information  was  presumed  known  in 
the  above  derivation.  Of  course,  the  source  angle  estimates  in  (14)  do 

2  2 

require  knowledge  of  the  signal-to-noise  ratio  ag/oju  in  the  x(t)  measurement 

of  the  antenna  angle  a(t).  Once  the  decision  of  vs  H2  is  made  via  (19), 
the  corresponding  estimate  of  the  actual  source  angle  o  is  taken  from  (14). 
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On  the  Performance  of  Test  (19) 


From  (5)  and  (6),  we  find  that 


X  y  =0  for  m  ^  n  . 
m  n 


(20) 


Then  (17A)  yields  the  mean  value  of  the  generalized  likelihood  ratio  test 
statistic  as 


r:(K-i)  .2 

I  (K-1)  ol 


for  H 


.1 


for  H 


(21) 


Since  the  statistics  of  T  are  desired  different  under  the  two  hypotheses, 

(21)  indicates  that  large  K  and  o|  are  desired.  That  is,  a  large 
observation  time  and  a  widely-moving  antenna  give  better  performance  of  the 
test;  both  of  these  conclusions  are  physically  plausible. 


Although  generalized  likelihood  ratio  test  (19)  does  not  require 
knowledge  of  any  variances,  the  performance  (in  terms  of  the  error 
probability)  does  depend  on  all  the  variances.  However,  the  performance  does 
not  depend  on  the  actual  value  o  of  the  source  angle.  To  see  this,  we  employ 
(5)  in  (18)  to  obtain 


where 


*  "k  -  (-5.  * 

»  -k  -  (  S,  » 


S„)/K 

for  H 

S„)/K 

for  H 

(22) 
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Thus  9  is  absent  from  (22),  and  since  o  is  not  involved  in  x(t)  or  Xj^,  test 
statistic  T  is  independent  of  ©. 

If  we  develop  (19)  in  more  detail  and  make  use  of  (18)  and  (5),  we  find 
we  can  express 


^'"kX^k  -  "k> 


for  , 


for  H2  . 


(24) 


Thus  the  statistics  of  Tj^  are  identical  to  those  of  -T2. 

Based  upon  the  results  in  [2,3],  an  exact  analysis  of  the  cumulative  and 
exceedance  distribution  functions  of  test  statistic  (17A)  is  possible  and  will 
be  documented  in  a  NUSC  technical  report  shortly;  in  fact,  a  more  general 
processor,  where  the  sample  means  term  is  scaled  prior  to  subtraction,  will  be 
analyzed. 
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NOISELESS  MEASURED  ANTENNA  ANGLE 

In  this  section,  the  noise  m(t)  in  the  antenna  angle  measurement  is  zero; 
thus,  from  (3), 


x(t)  =  a{t)  (25) 

under  and  82*  We  also  remove  the  Gaussian  assumption  on  the  statistics 
of  antenna  movement  a(t),  and  allow  a{t)  to  be  completely  general. 
Furthermore,  we  allow  any  statistical  dependence  among  the  samples  A  of  a(t) 
in  (7).  However,  we  retain  the  Gaussian  assumption  on  the  additive  noise 
process  n{t}  in  (4)  and  (5),  and  keep  the  statistical  independence  of  its 
samples  {n(kAj} 

Derivation  of  Generalized  Likelihood  Ratio 


Based  upon  these  premises,  the  conditional  probability  density  function 
under  of  measurements  K,  Y,  for  a  fixed  A  and  hypothesized  is 


Pl(X,  A)  =  IP  ]6(x 


k=l 


(26) 


(This  is  also  the  limit  of  (8)  as  ct^-*0+.)  Then  letting  joint  probability 
density  function  Pa(A)  represent  the  arbitrary  statistical  dependence  of 
samples  A,  the  unconditional  probability  density  function  under  of  X,  Y  is 


Pl{X,  Y|o^)  =  JdA  P3(A)  p^(X,  y|»j^.  A)  = 


=  (V?^ a^)  exp 


- 


*  \)'] 


Pa(X)  . 


(27) 


using  (26),  (9),  and  the  sifting  property  of  delta  functions.  (If  measurement 
noise  m(t)  in  (3)  were  non-zero,  this  simplification  of  the  probability 
density  function  in  (27)  would  not  be  possible.) 
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The  value  of  that  maximizes  probability  density  function  (27), 
regardless  of  the  form  of  the  probability  density  function  p^,  is 

»1  •  (28) 

Which  is  simply  the  sample  mean  of  the  sum  waveform  x(t)  +  y{t).  This  result 
is  consistent  with  the  earlier  one  in  (14A),  for  =  0,  and  the  ensuing 
discussion. 


which  is  the  sample  mean  of  difference  waveform  x(t)  -  y(t). 

There  follows,  from  (27)-(30),  the  logarithm  of  the  generalized 
likelihood  ratio  as 


The  generalized  likelihood  ratio  test  for  the  two  hypotheses  in  (1)  is 
therefore 


11 


TM  No.  831150 


2(*k  -  »l)^  i  ^(Xk  -  >k  -  *2)^  ’ 

“1 

or  upon  substitution  of  (28)  and  (30),  and  use  of  (18),  simply 

2Vk<^  °  • 

k 


(32) 


(33) 


As  in  tne  previous  section,  the  cross-correlation  of  the  sample  ac  components 
of  the  measurements  X,  Y  should  be  compared  with  zero.  This  decision  rule 
holds  for  any  statistics  of  antenna  movement  a(t). 

The  alternative  form  in  (32)  has  an  interesting  interpretation: 

Reference  to  (27)-(28)  reveals  that  is  the  best  constant  fit  to 
{^k  yk}f  ii^  ^  least  squares  sense.  Thus  the  left  side  of  (32)  is 
the  actual  value  of  the  least  squares  error  of  a  constant  fit  to  the  sum 
waveform.  Similarly,  the  right  side  of  (32)  is  the  least  squares  error  of  a 
constant  fit  to  the  difference  waveform.  Whichever  error  is  smaller,  that 
hypothesis  is  selected.  This  decision  rule,  (32),  is  consistent  with  the 
observation  from  (5)  and  (25)  that 

*  y(t)  =  ©  +  n(t)  under  , 

x(t)  -  y(t)  =  ©  -  n(t)  under  H2  .  (34) 

That  is,  except  for  zero-mean  measurement  noise  n(t),  the  sum  waveform  is 
constant  under  whereas  the  difference  waveform  is  constant  under  H2. 

An  alternative  form  for  (32)  and  (33)  is 
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-  |Vk  -  K  |*n,  2y„  i  0.  (35) 

K  “  "  U 

^1 

just  as  In  {17A).  All  the  ensuing  discussion  there  through  (24)  is  directly 
relevant  for  this  case  as  well. 
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SUMMARY 

The  generalized  likelihood  ratio  test  statistic,  for  both  the  noisy  as 
well  as  the  noiseless  antenna  angle  measurement,  is  a  cross-correlator  of  the 
sample  ac  components  of  the  measured  antenna  and  source  angle  waveforms. 

Exact  performance  of  this  processor  can  be  accomplished,  since  the  test 
statistic  is  a  quadratic  form  of  correlated  Gaussian  random  variables;  in 
fact,  the  complete  cumulative  and  exceedance  distribution  functions  of  the 
quantity 


K  K  K 

2  ^k^k  ~  i  ^  \  5 

k^l  rrixl  Hsl 

for  any  scaling  y*  is  capable  of  exact  analysis  and  will  be  presented  in  a 
future  NUSC  technical  report. 
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A.  H.  Nuttali 

ABSTRACT 

The  characteristic  function  of  the  output  of  a  crosscorrelator,  with 
the  sample  means  removed  from  each  channel,  is  derived  in  closed 
form.  More  generally,  if  scaled  versions  of  the  sample  means  are  sub¬ 
tracted  prior  to  multiplication  of  the  channel  inputs  and  summation,  a 
closed  form  for  the  characteristic  function  of  the  correlator  output  is 
derived.  These  results  are  used  to  plot  the  exact  operating  characteris¬ 
tics  of  the  crosscorrelator,  as  functions  of  the  threshold,  the  general 
scaling  factors  applied  to  the  sample  means,  the  number  of  terms,  N, 
summed  to  yield  the  output,  the  actual  means  at  the  inputs,  and  the 
signal-to-noise  ratios  of  the  rand  sm  signal  components  at  each  of  the 
system  inputs.  Programs  for  the  various  cases  considered  are 
documented  and  exercised.  Comparisons  are  made  with  a  Gaussian 
approximation,  which  can  be  used  to  extend  the  results  to  larger  values 
of  N  than  considered  here,  if  needed.  Asymptotic  results  for  the 
exceedance  distribution  functions  also  have  been  derived,  but  they  are 
not  too  useful  for  large  N. 
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OPERATING  CHARACTERISTICS  OF  CROSSCORRELATOR 
WITH  OR  WITHOUT  SAMPLE  MEAN  REMOVAL 

INTRODUCTION 

The  detection  of  weak  signals  in  two  channels  is  often  accomplished  by 
crosscorrelating  the  two  waveforms  and  comparing  with  a  threshold.  For  the 
case  where  a  large  number  of  independent  products  are  added  to  yield  the 
correlator  output,  the  central  limit  theorem  is  often  employed,  with 
questionable  validity  for  low  false  alarm  probabilities,  i.e.  large  thresholds. 
Also,  this  approximation  may  not  be  valid  for  intermediate  numbers  of  terms 
added. 

Here  we  wish  to  get  exact  operating  characteristics  for  the 
crosscorrelator,  namely  detection  probability  vs.  false  alarm  probability, 
even  for  probabilities  as  low  as  lE-10.  In  particular,  we  desire  results  for 
an  arbitrary  number  of  products  summed,  for  any  degree  of  correlation  between 
corresponding  individual  samples  of  the  two  channel  inputs,  and  for  any  input 
signal  and  noise  power  levels. 

Furthermore,  it  sometimes  happens  that  the  two  input  channels  contain  dc 
components,  which  can  be  considered  either  desirable  or  otherwise,  depending 
on  the  application.  Here  we  will  consider  these  dc  components  as  nuisance 
terms  and  will  subtract  them  out  prior  to  crosscorrelation.  More  precisely, 
since  the  actual  values  of  the  dc  components  in  each  channel  will  generally  be 
unknown,  we  will  estimate  them  via  the  sample  means  (over  the  available  record 
lengths)  and  subtract  these  estimates  from  the  available  data.  This 
subtraction  feature  creates  new  random  variables,  all  of  which  are 
statistically  dependent  on  each  other,  and  thereby  significantly  complicates 
the  analysis.  Nevertheless,  this  crosscorrelation  of  the  sample  ac  components 
of  the  input  channels  is  encountered  in  practical  situations,  and  in  one  recent 
study  [1],  it  was  in  fact  the  generalized  likelihood  ratio  detector  under  two 
different  realistic  scenarios.  Accordingly,  it  merits  study  and  accurate 
quantitative  evaluation  of  performance  capability. 
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More  generally,  we  consider  subtraction  of  scaled  versions  of  the  sample 
means  of  each  channel  prior  to  multiplication  and  summation.  Then  as  special 
cases,  we  can  investigate  the  crosscorrelator  with  or  without  sample  mean 
removal,  or  any  intermediate  case  of  interest. 

The  major  analytical  result  here  is  a  closed  form  for  the  characteristic 
function  of  the  correlator  output,  in  the  most  compact  form  involving  only  two 
rooting  operations  and  one  exponential.  Although  this  processor  could  be 
analyzed  by  the  general  method  given  in  [2],  in  terms  of  the  eigenvalues  and 
eigenvectors  of  a  correlation  matrix,  it  would  be  less  accurate  and 
considerably  more  time  consuming,  even  with  computer  aid,  especially  for  a 
large  number  of  terms  summed.  The  actual  numerical  procedure  adopted  here  for 
proceeding  from  the  characteristic  function  to  the  exceedance  distribution 
functions  (false  alarm  and  detection  probabilities)  is  that  given  in  [3],  and 
utilized  to  advantage  in  [2,3,4]. 
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PROBLEM  DEFINITION 


INPUT  STATISTICS 

The  two  channel  inputs  to  the  crosscorrel ator  are  synchronously  sampled 
in  time,  yielding  random  variables  and  {vp*}]*,  where  N  is 

the  total  number  of  data  samples  taken  in  each  channel.  These  random 
variables  are  Gaussian  with  the  following  statistics: 


means 

"^n  “  '^n  “  ^v*  1 

> 

►  all 

independent 
of  n. 

variances 

-  %•  (V^>^  -  1 

(1) 

covariances 

=  “"u’v- 

(An  overbar  denotes  a  statistical  average.)  That  is,  the  means  and  variances 
in  each  channel,  although  different,  do  not  change  with  time,  and  the  degree 
of  correlation  between  channels  is  constant.  Also 


is  statistically  independent  of  Up  if  m^n, 

is  statistically  independent  of  Vp  if  m^n,  (2) 

is  statistically  independent  of  Vp  if  m^n. 

However,  Up  and  Vp  are  statistically  dependent  on  each  other,  for  all  n, 
to  the  extent  p  indicated  in  (1). 

A  SIGNAL  AND  NOISE  MODEL 


To  better  fix  the  mathematical  definitions  above,  consider  in  this 
subsection  the  following  possible  signal  and  noise  model: 


*^n  »  »u  115(0)  +  Ud(n) 
''n  -  »v  ''d(") 


for  1  <  n  <  N, 


(3) 
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where  random  signal  components  u^(n),  Vg(n)  are  zero-mean  and  partially 
correlated  with  each  other; 


u^TnT  -  0,  v^(n)  =  0, 


all  n.  (4) 


uf(n)  =  v^(n)  =  S^.  u^(n)  v^(n)  =  J 

Thus  Sy  are  the  powers  of  the  random  signal  components  in  each  channel. 

Also,  the  random  noise  disturbances  Ujj(n),  Vjj(n)  in  (3)  are  zeronmean 
and  independent  of  each  other; 


u^j(n)  =  0.  Vj(n)  =  0, 


*  Oy*  =  Oy.  Ud(nT  Vd(n)  »  0 


for  all  n.  (5) 


Thus  Oy  are  the  powers  of  the  random  noise  disturbances  in  each 
channel.  Finally,  except  for  the  statistical  dependencies  indicated  in  (4) 
between  u^{n)  and  v^(n),  all  the  4N  random  components  in  (3)  are 
independent  of  each  other. 


For  this  particular  signal  and  noise  model  in  (3)-(5),  the  master 
parameters  in  (1)  take  the  special  form 


S  +D  ,  o 
u  u*  V 


S  +0  , 

V  V’ 


-sISuSv) 


1/2 


from  which  there  follows 


(6) 


(7) 
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where  the  signal-to-nolse  ratios  (per  sample)  of  the  random  components  in  f3) 
have  been  defined  as 


,  S,  v2(n) 

1 -  ’  V  -  D  -  - 

v^(n) 


for  all  n. 


Thus  the  parameters  o^,  p  in  (1)  depend  only  on  the  statistics  of  the 
random  components  in  model  (3),  and  not  on  the  dc  components  p  and  u 

Observe  that  even  if  and  p  would  still  be  less  than  1;  the  one 

noisy  channel  prevents  full  correlation  between  inputs. 

CROSSCORRELATOR  OUTPUT 

We  define  the  sample  ac  components  of  each  channel  of  the  crosscorrelator 


%  “  “n  -  S 

N 

“n  •  ''n  -  -R  ^ 


for  1  <  n  <  N, 


where  we  have  subtracted  the  corresponding  sample  means  from  each  and  every 
data  sample.  Thus  and  {vjj  have  zero-means  and  have  statistics 

completely  independent  of  the  unknown  actual  values  of  input  means  Wy,  u  . 
However,  in  trade,  we  now  must  deal  with  a  new  set  of  2N  random  variables,  all 
of  which  are  statistically  dependent  on  each  other;  this  is  the  feature  which 
complicates  the  ensuing  analysis.  The  test  statistic  (decision  variable)  of 
interest  is  the  crosscorrelator  output  after  sample  mean  removal. 


5v.-5v.-i2-.2 
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which  is  independent  of  the  actual  unknown  values  of  input  means  and 

If  we  knew  th<i  input  means,  we  couid  subtract  them  directly  and  not  have  to 
resort  to  sample  means. 


More  generally,  we  consider  the  modified  channel  components 


N 


a 


m=l 

N 


m»l  J 


for  1  <  n  <  N 


(11) 


and  the  crosscorrelator  output 


N  N 


N  N 


2  ^  W  -  N  ^  2  ''n  • 


(12) 


n=l  n«l 


m»l  nstl 


instead  of  (9)  and  (10).  Scale  factors  a  and/or  e  in  (11)  may  oe  unequal  to  1; 
the  final  parameter  y  in  (12)  is  given  by 

Y=o+B-a8=l-  (o-l)(8-l).  (13) 


The  case  of  y*0  in  (12)  obviously  corresponds  to  the  case  of  no  sample  mean 
removal.  On  the  other  hand,  if  either*  a»l  or  8»1,  then  y-li  and  we  have 
removal  of  the  sample  mean;  i.e.,  (12)  reduces  to  (10).  We  shall  be  interested 
here  in  the  analysis  of  the  general  case  represented  by  (12),  for  arbitrary  y 


*  It  is  demonstrated  in  appendix  A  that  if  scale  factor  a«l  but  8^1, 
correlator  output  q  is  completely  independent  of  g. 
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CHARACTERISTIC  FUNCTION  OF  CROSSCORRELATOR  OUTPUT 


DERIVATION 

We  express  the  collection  of  random  variables  in  (1)  and  (2)  in  column 
matrix  form  according  to 

U  =  [u^  U2  ...  V  »  [v^  ...  ,  (14) 

where  superscript  T  denotes  transpose.  The  crosscorrelator  output  q  in  (12) 
can  then  be  written  as  quadratic  form 

q  =  u'^'q  V  ,  (15) 

where:  NxN  matrix 

q.I-Jll’',  (16) 

I  is  the  NxN  identity  matrix,  and 

1  =  [1  1  ...  if  (17) 


is  a  Nxl  column  matrix  of  ones. 

Since  U  and  V  are  Gaussian,  their  joint  probability  density  function  is, 
in  terms  of  the  parameters  in  (1), 

p(U,V)  »  jltroyay  (l-p^^  J 

*|\(U  -  Myl)'^(U  -  u^l)  +  -  Myl)''‘(V 

l®u  ®v 

The  characteristic  function  of  correlator 
the  statistical  average 


exp - ^  * 

I  2(l-p2) 

output  q  in  (15)  is  then  given  by 
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fq(5)  =  exp(i?q)  =  exp(i?U  QV)  = 


=  jJdU  dV  p(U,V}  exp(ijU^QV) 


dU  dV  exp 


i?uV - W-  * 

2(1-0^) 


-  u„i)  +  V’'  - 

>u  "v  “ 


«vin.(i9) 


At  this  point,  in  order  to  evaluate  this  2N-fold  integral,  we  employ  the 
general  integral  result  (B-2)  and  (B-6)  in  appendix  B,  identifying  the 
matrices  there  as 


A  =  -j--'  I,  B  ^  ^  ^  ^  I,  C  =  i?Q  + 


»„(l-c  ) 


!. 


oil  —  oou  au  —  Dou 

n  V^U  ^  U^V  1  r  U  V  ^  V^U  1 

U  SS  o  o'  *^1  U  —  o  o  -I  • 


2  n  2v 


2/1  2v 


(20) 


We  also  need  the  following  auxiliary  results  for  special  matrix  forms;  namely, 
for  arbitrary  scalars  Cj,  C2,  the  matrix  determinant 


det(Cj^I  1  1^)  =  ^(Cj^  +  Nc^), 

and  the  matrix  inverse 


(Cjl  *  1  1^)'^  =  ^  I  - 


^2  ,  ,T 

Cj(c^  +  Nc^) 


(21) 


(22) 


Employment  of  appendix  B  and  (20)-(22)  then  yields,  after  a  very  considerable 
amount  of  effort,  a  closed  form  for  the  characteristic  function  in  (19)  (in 
its  most  compact  form) 
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exp 


2J 


(■ 


TfT 

IfE,  -T%)  (l  - 


ijFi  + 


(23) 


where 


E,  «  2po^^ay.  =  o^o^(l-p^)  . 


Fi  «  Ej(I-y),  ^2  “ 


6j  =  N(l-Y)u^jUy,  G2  =  |fl(l-Y)^(OyMy  *  -  2pOjjO^UyMy)-  (24) 

The  square  roots  in  (23)  are  principal  value,  being  +1  at  ?=0.  This 
characteristic  function  has  four  branch  points  and  two  essential  singularities 
which  overlap  two  of  the  branch  points;  the  complexity  of  this  characteristic 
function  of  q  precludes  tractable  analytical  results  for  the  probability 
density  function  or  exceedance  distribution  function  of  the  correlator  output, 
except  in  very  special  cases.  Nevertheless,  since  the  characteristic  function 
in  (23)  is  easily  numerically  evaluated  with  computer  aid,  it  readily  lends 
itself  to  the  procedure  presented  in  [2,3].  A  program  for  the  evaluation  of 
the  cumulative  and  exceedance  distribution  functions  corresponding  to 
characteristic  function  (23)-(24)  is  given  in  appendix  C  for  arbitrary  values 
of 


N,  number  of  terms  summed 

Y,  scale  factor  in  sample  mean  removal 

Wy,  mean  in  u-channel 

My,  mean  in  v-channel 

Oy,  standard  deviation  in  u-channel 

Oy,  standard  deviation  in  v-channel 

p,  correlation  coefficient  between  channels. 
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A  sample  plot  of  the  cumulative  and  exceedance  distribution  functions  for  a 
typical  selection  of  numerical  values  for  the  above  parameters  is  also 
presented  in  appendix  C. 

CUMULANTS  OF  CORRELATOR  OUTPUT 

By  taking  the  natural  logarithm  of  the  characteristic  function  in  (23) 
and  expanding  in  a  power  series  in  the  cumulants  of  random  variable  q  can 
be  extracted: 

•X^'n)  .^{n-l);[N-Hl-r)"]  ♦  d")  + 

+  i ti / 1  \n/  »n— 2/  2  2.  2  2\/oi^“l  iocs 

+ -^niNCl-Y)  (OyOy.)  '®u*‘v  ^v^u''^  ^ 

where  here 


S  =  p  +  1,  0»p-l.  (26) 

In  particular,  the  mean  and  variance  of  q  are  available  by  using  n=l  and  2 
respectively  in  (25): 


Hq  »  (N-T)payOy  +  N(l-Y)»iyyy, 


Oq  »  (N-2Y+Y^)(l+P^)cryOy  N(l-Y)^(oyMy  +  OyMy  +  ^pOjjOyUyijy ) , 


(27) 


SPECIAL  CASE  OF  y»1.  SAMPLE  MEAN  REMOVAL 


For  Y-lt  the  general  characteristic  function  in  (23)  reduces  to 


fq(?;  Y-1) 


N-1 

“T 


(28) 
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where  and  E2  are  still  given  by  (24),  and  are  independent  of  means  Wy 
and  Uy,  as  shown  earlier.  The  cumulants  in  (25)  reduce  to 

X,(n)  .^(n-l)!(N-l)(=„o^,)"C(»n)"  +  (a-1)"]  , 

and  in  particular,  the  mean  and  variance  of  q  are 

Uq  -  (N-l)po^Oy, 

Oq  =  (N-1) (1+p^ )oyay  . 

SPECIAL  CASE  OF  y=0,  SAMPLE  MEAN  NOT  REMOVED 


For  Y“0»  the  characteristic  function  in  (23)  reduces  to 


f,{f:r=0) 


,  5  V -.N/2  r  +  iSG^°^ 

(l  -  iKi  exp  ij  -i - 1-  , 


where 

El  =  2pa^^%»  E2  »  a^ajd-p^). 

The  cumulants  are  obtained  by  setting  y=0  in  (25),  and  in  particular,  the  mean 
and  variance  of  correlator  output  q  are 


Mq  =  N(payOy  +  u^uy) 


N  {l+p^)ff^a^  +  +  2po 

'  '  u  V  u^v  V  u  ^ 


u°''“u'‘v]' 
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INTERRELATIONSHIP  OF  TWO  SPECIAL  CASES 

Let  the  general  characteristic  function  in  (23)  be  denoted  by 
^q(5;  N,  Y»  Py)*  We  ^lave  already  seen  the  expression  for 
fq(P;  N,  1,  Myi  Uy)  in  (28).  At  the  same  time*  from  (23)  and  (24),  there 
follows 

N-1 
— 'T' 

:  N-1,  0,  0,  0.)  .  (l  -  ilEj  ♦  ,  (34) 

which  is  identical  to  (28).  That  is, 

fq(?;  N,  1,  u^)  =  fq(F;  N-1,  0,  0,  0).  (35) 

Thus  the  characteristic  functions  of  the  two  following  random  variables  are 
identical : 

(1)  Sum  of  N  terms  with  sample  mean  removal,  and  the  true  means 
arbitrary, 

(2)  Sum  of  N-1  terms  without  sample  mean  removal,  but  the  true  means 

zero.  (36) 

The  removal  of  the  sample  means  has  eliminated  the  dependence  of  the  correlator 
output  on  the  unknown  means  but  has  reduced  the  number  of  degrees  of  freedom  by  1. 

SPECIALIZATION  TO  THE  SIGNAL  AND  NOISE  MODEL 

For  general  scaling  factor  y  and  arbitrary  input  means  and  for 

the  model  introduced  earlier  in  (3)-(6),  the  general  characteristic  function  of 
the  correlator  output  is  still  given  by  (23),  but  with  the  parauneters  in  (24) 
now  specialized  to  the  form 
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Ej  -  20s(SuS,)^'^  Ej  -  0„D/D^S/D,S^‘Sj,S^,(1-4>. 

Fj  -  Ejd-T),  Fj  .  Ejd-r)^, 

Gj  -  Nd-Y)w„i.,.  Gj  .  |«(l-r)^[(S/0^)u^-(S/D^)„^-2o5(S^S,)^'^»„u^]  .  (37) 

The  general  n-th  cumulant  is  still  given  by  (25);  however,  the  use  of  (6) 
allows  for  determination  in  terms  of  the  fundamental  quantities  of  the  signal 
and  noise  model,  namely  S^,  s^,  0^,  0^,  defined  in  (4}-(5).  In 
particular,  the  mean  and  variance  of  correlator  output  q  are 

Uq  «  +  N{l-Y)UjjUy, 

-  (N-2T^Y^)[D„0/0„S/D,S„*d*Pj^)S„S,]* 

*  N(l-T)^C(V“u)“^<5,*Dv)»^2Ps(S„S,)^'^„»,].  (38) 
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ANALYTIC  RESULTS  FOR  y-1,  SAMPLE  MEAN  REMOVAL 

In  this  section  and  the  next,  we  will  confine  attention  solely  to  the 
case  of  scale  factor  y»1«  The  characteristic  function  of  the  crosscorrelator 
output  q  follows  from  (28)  and  (24)  as 

_  N-1  N-1 

=  [1  -  iiEi  =  [1  - 

_ 

=  {[l+iFouOy{l-p)]  [l-ifoyOyd+p)^  for  Y=1  .  (39) 

where  we  must  have  N22.  We  observe,  for  later  numerical  use  in  appendix  D, 
that  since  jl  ±  ijbj  =  (1  is  monotonically  increasing  forj^O, 

then  |Tq(jf)|  is  monotonically  decreasing  for  all  jf^O  and  any  N,  Ojj,  Oy,  p. 

GENERAL  PROBABILITY  RESULTS 

The  cumulants  of  q  have  already  been  listed  in  (29)  and  (30).  The 
probability  density  function  corresponding  to  characteristic  function  (39)  is 
given  by  [5,  6.699  12] 


where  K^(z)  is  a  modified  Bessel  function  of  the  second  kind  [6,  section  9.6]. 
If  the  number  of  terms  added,  N,  to  yield  correlator  output  q,  is  odd,  simple 
relations  for  the  probability  density  function  in  (40)  can  be  obtained 

N— 3 

[6,  10.2.15  and  10.1.9,  last  equation];  letting  n  » -y  for  N  odd,  we  find  the 
exact  result 
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P<,(u) 


exp 


for  dll  Uj  n  =  — -g— ■,  N  =  3,  5,  7,  ...  . 
For  example,  for  N=3,  we  have  n=0,  yielding 

/ou  -  |ul  \ 

<1  ^ 


The  corresponding  cumulative  distribution  function  for  N=3  is 


(41) 


(42) 


P^(u)  .  [  dt  p^(t)  .  if-  exp/-- for  u<0,  (43A) 

—CO  \  U  V  / 

while  the  exceedance  distribution  function  is 

4.00 

1  -  P,(u)  -  ^dt  p^(t)  .  if  for  u>0.  (43B) 

u  \  U  V  / 

This  dichotomy,  of  presenting  the  cumulative  distribution  function  for 
negative  arguments,  and  the  exceedance  distribution  function  for  positive 
arguments,  turns  out  to  be  notationally  convenient  and  physically  meaningful 
and  will  be  adopted  throughout  this  report. 


Although  closed  form  expressions  for  the  exceedance  distribution  function 
corresponding  to  probability  density  function  (40)  are  not  available  for 
general  N,  the  use  of  [6,  9.7.2]  on  (40)  leads  to  the  dominant  term  in  the 
asymptotic  expansion  of  the  exceedance  distribution  function: 


as  u  ->  +•«  .  (44) 


For  N-3,  this  is  precise;  see  (43B). 
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POSSIBLE  NORMALIZATIONS  OF  q 

If  we  define  a  normalized  random  variable 

*  -  - ,'T7?  ■ 

then  the  characteristic  function  of  x  is  given  by  (39)  as 

■  f-OTi/i;"-!’]  ■ 

which  has  only  two  fundamental  parameters,  namely,  N  and  p. 
A  second  possibility  is  the  random  variable  defined  by 


1/2, 


f,(?)  - 


i?2p(; 


(45) 


(46) 


y  = 


a  a 
U  V 


(47) 


for  which  characteristic  function 

_  N-1 

■  li  ■ 

also  depends  only  on  N  and  p.  However,  neither  of  the  normalizations,  (45)  and 
(47),  are  of  interest  to  us  here;  an  alternative  normalization  and  reasons  for 
its  selection  are  given  below. 
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SPECIALIZATION  TO  THE  SIGNAL  AND  NOISE  MODEL 

For  the  model  presented  earlier  in  (3)-(8),  the  original  Ej^,  E2 
parameters  in  (24)  take  the  form  already  given  in  the  upper  line  of  (37), 
Let  a  normalized  random  variable,  relative  to  the  additive  random  noise 
disturbances,  be  defined  according  to 


(0  D 

see  (5).  This  normalization  for  the  particular  signal  model  (3)  is  different 
from  both  x  and  y  in  the  general  case  above.  The  reason  we  employ  h  is  that 
the  normalization  depends  only  on  the  power  of  the  additive  noise 
disturbances,  and  not  on  the  signal  strengths  or  correlation  coefficients; 
this  is  consistent  with  a  system  which  monitors  the  noise-only  background  and 
sets  a  threshold  for  a  desired  false  alarm  probability. 

The  characteristic  function  of  the  normalized  random  variable  h  in  (49) 
is  given  by 


1  -  i! 


(D„Dv)- 


^  or 


[i  -  iJ2a 


where  we  define  auxiliary  parameters  here  as 

»  -  .  8  =  .  (51) 

Here  we  used  (39),  (37),  and  (8).  This  characteristic  function  in  (50) 
depends  on  the  four  fundamental  parameters  N,  p.,  r„,  r„,  where  the 
latter  two  quantities  are  the  signal-to-noise  ratios  per  sample  of  the  random 
components  of  model  (3);  see  (8), 
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Reference  to  (40)  reveals  that  the  probability  density  function  of  h 
corresponding  to  characteristic  function  (50)  is  given  by 


For  N  odd,  alternative  forms  are  available  from  (41),  if  desired.  The 
asymptotic  behavior  of  the  exceedance  distribution  function  of  h  follows  in  a 
manner  similar  to  that  used  for  (44); 


The  cumulants  of  h  follow  from  (29),  (26),  and  (6)-(8): 


Xh(n)  >4(n-l);(N-l)[(a+8)"  (a-B)"]  . 

and  in  particular,  the  mean  and  variance  of  h  are 


(53) 


(54) 


=  (N-1)(.^+b^)  .  (N-l)[l  +  R,+  R/^d+Oj)]  .  (55) 

The  two  parameters,  a  and  e,  are  given  here  by  (51),  in  terms  of  the 
fundamental  quantities  R^,  R^,  of  the  signal  and  noise  model. 

REDUCTION  TO  IDENTICAL  SIGNAL  COMPONENTS 

At  this  point,  we  will  further  specialize  the  results  for  the  signal  and 
noise  model  in  the  above  subsection.  We  presume  that 
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*^u  =  Ry  =  and  Pg  »  1  , 


(56A) 


giving,  from  (51), 


a  »  R,  B  =  1+R;  (56B) 

that  is,  the  signal-to-noise  ratios  in  the  two  channels  are  equal,  and  the  two 
channel  signals  are  fully  correlated.  This  corresponds  physically  to  a  case 
where  the  random  signal  components  in  (3)  are  identical,  u^(n)  = 
and  the  independent  random  noise  disturbances  have  the  same  power  level.  This 
situation  will  hold  for  the  rest  of  this  section  and  all  of  the  next  section 
where  the  graphical  results  are  presented. 

Equations  (50)  and  (56B)  then  yield  the  characteristic  function  for 
normalized  random  variable  h  in  (49)  as 


_  HA 

fh(f)  •  [1  -  'fZK  ♦f’^(l*2R)] 

.  Jti 

=  [(1  ♦  7){1  -  1f(l*2R)n  ^  .  (57) 

The  cumulants  in  (54)  reduce  to 

-^(n-l):{N-l)[(l+2R)"*(-l)"]  ,  (58) 

and  in  particular,  the  mean  and  variance  become 

Pj,  «  (N-l)R,  ol  =  (N-1)(1+2R+2R^)  .  (59) 

All  the  above  statistical  descriptions  depend  only  on  the  two  parameters  R, 
the  per-sample  signal-to-noise  ratio,  and  N,  the  number  of  terms  added  to 
yield  the  correlator  output. 
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The  probability  density  function  for  h  follows  from  (52)  as 


and  the  asymptotic  exceedance  distribution  function  from  (53): 


(60) 


N-3 

^  (61) 

An  important  word  of  caution  must  be  mentioned  at  this  point:  when  N  is  large, 
(61)  is  inadequate  for  evaluating  small  false  alarm  and  detection 
probabilities,  since  the  succeeding  terms  in  the  asymptotic  expansion 
contribute  significantly.  For  example,  when  R=0,  the  maximum  value  of  the 
dominant  term  (61)  occurs  when  u  =  (N-3)/2  which,  for  N»128,  yields  false 
alarm  probability  3.86E-21,  a  value  far  below  those  of  interest.  Thus  (61) 
has  limited  applicability,  being  best  for  small  N;  in  fact,  the  first 
correction  term  to  (61)  yields  the  multiplicative  factor 

1 .  .  (62) 

It  indicates  that,  for  large  N,  u  must  be  of  the  order  of  N  in  order  for 
the  dominant  term  (61)  to  be  fairly  accurate. 

Although  for  N  odd,  an  alternative  closed  form  to  the  probability  density 
function  (60)  of  h  is  available  from  (41),  the  exceedance  distribution  function 
will  generate  a  double  sum  and  be  rather  cumbersome  for  large  N.  On  the  other 
hand,  the  characteristic  function  in  (57)  decays  rapidly  with  f  when  N  is  large 
and  yields  very  nicely  to  the  numerical  approach  given  in  [2,3].  The  only  diffi¬ 
cult  cases  are  in  fact  those  for  small  N;  accordingly,  some  analytic  results  for 
N  =  2,  3,  4,  5  will  now  be  presented,  based  on  characteristic  function  (57). 
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GENERAL  DISTRIBUTION  INTEGRALS 


Suppose  a  random  variable  y  has  characteristic  function  fy(f).  The 
cumulative  distribution  function  of  y  can  be  written  as  a  contour  integral 
[3,  (5)J?  (6)] 


P  (u) 

y 


1 

T2^ 


t 


exp(-iuf)  for  all  u 


(63) 


where  is  a  contour  along  the  real  axis  of  the  complex  ^-plane,  with  an 
upward  indentation  at  the  origin  f=0,  to  avoid  the  pole  of  the  integrand  there. 


Similarly,  the  exceedance  distribution  function  of  random  variable  y  can 
be  expressed  as 


1  -  Py(u)  =  J  df  exp(-iuf)  for  all  u  ,  (64) 

C_ 

where  C_  is  a  contour  along  the  real  f  axis,  with  a  downward  indentation  at 

?=0. 


For  u<0,  both  contours  can  be  inovaJ  tntk  the  upper-half  7-plane,  since  the 
exp  term  furnishes  rapid  decay  there.  Similarly,  for  u>0,  both  contours  can 
be  movt4  liiib  the  lower-half  f-plane,  to  realize  exponential  decay  on  the 
circular  arcs  tending  to  infinity. 

DISTRIBUTIONS  FOR  N=2 

From  (57),  the  characteristic  function  of  normalized  correlator  output  h 
is 


fh(f)  -  ,  (65) 

and  the  probability  density  function  follows  from  (60)  as 
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Ph(u) 


r(l+2R)^ 


for  ill  u 


There  is  no  closed  form  for  the  indefinite  integral  of  a  function;  see 
[6,  11.1.8  and  11.1.9].  Instead,  we  use  (65)  in  (63)  and  move  the  contour 
upwards  until  it  wraps  around  the  branch  point  at  |»i  and  extends  vertically  lApward 
from  there;  this  is  in  fact  the  steepest  descent  direction  for  the 

when  u<(X 

exponential The  contributions  of  the  small  and  large  circular  arcs  tend  to 
zero  as  the  radii  tend  to  zero  and  infinity,  respectively.  Under  a  change  of 
variable,  there  follows  the  cumulative  distribution  function  in  the  form 


dt  exp[u(l-»-r  )] 
(l+t^)[l+(l+2R)(l+t^)]^^^ 


for  u  <  0 


This  is  a  useful  exact  result  for  several  reasons:  the  integrand  decays 
rapidly,  has  no  cusps,  and  involves  only  elementary  functions  which  are  easily 
computed;  also  the  integral  is  a  sum  of  positive  quantities  and  retains 
significance  even  for  large  |uj. 

In  a  similar  fashion,  if  characteristic  function  (65)  is  substituted  in 

(64)  and  the  contour  moved  down  and  wrapped  around  the  branch  point  at 

1=  -i/(l+2R)  and  along  tiierTertical  steepest  descent  direction  for  the 
Wfrtlfl  u>o,  ” 

exponential^^  the  exceedance  distribution  function  becomes,  upon  a  change  of 
variable. 


1  -  P,(u)  .  i(l*2R)  exp(^r  — 

<1  n+ 


dt  exp(-ut^) _ 

>\4.2TriJ./1  J-OO  \  /  1  j.4.2  1 


[  l+(  1+2R )  t^][  l+(  1+2R )  ( 1+r )  ] 


Yjj  for  u  2  0*  (68) 


This  is  useful  for  the  same  reasons  given  above. 

There  is  one  closed  form  result  possible;  namely,  for  u*0,  direct 
integration  of  probability  density  function  (66)  yields  [5,  6.611  9] 


^h^^^  “it  ^^^^I+r)  *  “  It  ’ 
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DISTRIBUTIONS  FOR  N=3 

Use  of  [6,  10.2.17]  on  (60)  immediately  yields  probability  density 
function 


Ph(u)  . 


exp(u) 


for  u  <  0 


5tW 


for  u  >  0 


The  cumulative  and  exceedance  distribution  functions  easily  follow  as 


This  latter  result  corroborates  (61)  and  (62). 


for  u  <  0  , 


for  u  >  0  . 


DISTRIBUTIONS  FOP  N=4 

The  only  closed  form  result  possible  is  obtained  by  direct  integration  of 
probability  density  function  (60)  to  get  origin  value 


Ph(0) 


■  J  [•" 


This  follows  by  use  of  the  integral 


r 

jdx  e  X  KjCsx)  =r 


6  arc  cos(o/e; 

,  2  2 
(8  -a  ) 


6(8-0^) 


for  8  >  -a  ,  (73) 


which  follows  from  [5,  6.611  9]  by  applying  a/ae  to  both  sides. 
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DISTRIBUTIONS  FOR  N-5 

Use  of  [6,  10.2.17]  on  (60)  immediately  yields  probability  density 
function 


y)-  exp(u)  for  u  £  0 


4(1+R)' 

)-  exp  ( for  u  >  0 


4(1+R)' 


The  cumulative  and  exceedance  distribution  functions  follow  as 


(74) 


P.  (u)  =  — ^  exp(u)  for  u  <  0, 

^  4(1+R)'^ 

1  -  p^(u)  =  [(H'2R)(2-H))t(l**)u]  exp(3i^)  for  u  >  0  .  (75) 

This  latter  result  corroborates  (61)  and  (62).  Also,  this  example  was  used  as 
a  check  on  the  numerical  procedure  [3]  applied  directly  to  the  characteristic 
function,  which  is  used  in  the  following  section;  the  agreement  was  ten 
decimals  for  numerous  values  of  R  and  u. 
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GRAPHICAL  RESULTS  FOR  y»U  SAMPLE  MEAN  REMOVAL 
SUMMARY  OF  PARTICULAR  CASE  CONSIDERED 


We  first  summarize  here  the  particular  case  that  will  be  considered 
quantitatively  in  this  section.  The  input  samples  are 


=  wy  +  73(0)  +  v^{n) 


for  1  <  n  <  N, 


(76) 


where  these  Gaussian  random  variables  have  statistics 


=  v^(n)  =  u^(n)  =  v^(n)  =  0  . 

UgCn)  =»  S^^,  v^(n)  =  Sy,  u^Tn]v^TnT  =  » 


Uj(n)  =  Vj{n)  =  D^,  u^(n)v^{n)  =  0  .  (77) 

We  presume  that  the  simultaneous  signal  components  u^(n),  V5(n)  in  the  two 
channels  are  fully  correlated,  that  all  other  random  variables  are 
independent,  and  that  the  two  channel  input  signal-to-noise  ratios 


117  =  117 

u  V 


=  R 


(78) 


have  a  common  value  R.  More  general  situations  have  been  considered  in 
earlier  sections;  however,  only  this  special  case  will  be  numerically 
evaluated  here. 
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The  normalized  crosscorrelator  output,  with  sample  mean  removal  is 

'  u  v'  nal 

where  the  sample  ac  components 

N  N 

^n  “  %  "  ^  2  •  ''n  “  %  -  I  ''m 

m=l  rtel 

The  characteristic  function  of  h  is  given  by  (57)  as 

_  N-1 

-  [(l*i5)(l-it(l+2R))]’”^ 

and  depends  only  on  signal-to-noise  ratio  R  and  number  of 
have  N^2. 

If  RaO  and  we  evaluate  the  exceedance  distribution  function  corresponding 
to  (81),  we  then  have  the  false  alarm  probability.  But  when  R>0,  the 
exceedance  distribution  function  corresponding  to  (81)  is  the  detection 
probability.  In  the  following,  we  plot  the  detection  probability  vs.  the 
false  alarm  probability,  with  signal-to-noise  ratio  R  as  a  parameter; 
different  values  of  N  are  handled  in  separate  plots. 

OPERATING  CHARACTERISTICS  FOR  y=1 

A  sample  program  for  evaluation  of  the  cumulative  and  exceedance 
distribution  functions  corresponding  to  characteristic  function  (PI),  and 
thereby  the  detection  probability  vs.  false  alarm  probability  operating 
characteristics  of  the  crosscorrelator  with  sample  mean  removal,  is  given  in 
appendix  0.  It  is  heavily  based  on  the  technique  developed  and  explained  in 
[3]. 


(79) 


(80) 


(81) 

terms  N.  We  must 
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In  figures*  1-14  are  presented  the  operating  characteristics  for  the 
crosscorrelator  with  sample  mean  removal,  for  values  of 

N  =  2,  3,  4,  6.  8,  12,  16.  24,  32.  48,  64.  96,  128,  256,  (82) 

respectively.  The  case  of  N=2  was  accomplished  by  use  of  (67)-(69);  results 
for  N=3  relied  on  (71);  and  the  remainder  for  N>4  employed  a  numerical 
procedure  [3]  proceeding  directly  from  characteristic  function  (81)  to  the 
exceedance  distribution  function.  False  alarm  probabilities  Pp  in  the  range 
lE-10  to  .5  and  detection  probabilities  covering  lE-10  to  .999  are 
presented.  The  abscissa  and  ordinate  on  these  plots  are  according  to  a  normal 
probability  transformation,  as  explained  below.  Values  of  signal-to-noise 
ratio  R  are  taken  as  R=2'’,  where  n  assumes  values  appropriate  for  each  plot 
in  order  to  cover  the  full  range  of  probabilities  of  interest. 

GAUSSIAN  APPROXIMATION 

Suppose  the  decision  variable  of  a  processor  is  Gaussian  with  mean  and 
standard  deviation  m^,  Oq  respectively  when  the  input  signal  is  absent, 
and  mj^,  when  signal  is  present.  Then  for  threshold^,  the  false  alarm 
probability  and  detection  probability  are 


respectively,  where  0  and  $  are  the  normalized  Gaussian  probability  density 
function  and  cumulative  distribution  function: 

u 

0(u)  =  (2if)"^^^  exp(-u^/2),  |(u)  «  fdt  0(t)  .  (84) 

If  we  let  be  the  inverse  function  to§,  and  define 

X  =$i(Pp).  y  =  IiCPq)  , 

''^See  p«je  -S’!  ti  S9y 


(85) 
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then  threshold  JV.  can  be  eliminated  from  (83)  to  yield 


y  « 


mi 


*^1 


(86) 


Equation  (85)  corresponds  to  the  transformation  to  normal  probability 
coordinates;  thus  a  plot  of  Pq  vs  Pp  on  normal  probability  paper  is  the 
straight  line  (86)  when  the  decision  variable  is  Gaussian  under  both 
hypotheses  of  signal  absent  as  well  as  present. 


Reference  to  (59)  reveals  that,  for  our  application. 


m^  =0.  mi  »  (N-l)R,  =  N-1,  =  {N-1)(1+2R+2R^)  ,  (87) 

since  setting  signal-to-noise  ratio  R=0  corresponds  to  hypothesis  0,  signal 
absent.  Substitution  in  (86)  yields 


J 


(N-1)^^^  R  +  X  . 

;  i72  "  * 
(1+2R+2R  ) 


(88) 


that  is,  if  normalized  crosscorrelator  output  h  were  Gaussian,  the  operating 
characteristics  would  be  straight  lines  dictated  by  (88).  These  straight 
lines  are  superposed  as  dashed  lines  in  figures  12-14  for  N=96,  128,  256 
respectively.  Despite  the  large  value  of  N=96  in  figure  12,  the  Gaussian 
approximation  is  not  that  accurate,  especially  for  small  false  alarm 
probabilities  and  large  detection  probabilities.  The  ex^ct  curve  (solid)  and 
the  Gaussian  approximation  (dashed)  cross  each  other,  and  are  labelled  at  the 
crossing  with  the  corresponding  value  of  n  in  signal-to-noise  ratio  R=2”. 

For  N=256  in  figure  14,  agreement  is  better  and  the  Gaussian  approximation  is 
probably  adequate  for  larger  N.  If  not,  an  additional  term  or  two  in  an 
Edgeworth  expansion  could  be  investigated  with  the  aid  of  the  cumulants  given 
in  (58). 
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An  obvious  shortcoming  of  the  Gaussian  approximation  (88)  may  be  seen 
immediately: 


lim  y  = 


for  any  x  . 


(89) 


Reference  to  (85)  then  yields  the  interpretation 


lim  P 

R-*«> 


D 


1  for  any  Pp 


(90) 


That  is,  as  input  signal-to-noise  ratio  R  tends  to  infinity,  the  approximate 
detection  probability  saturates  at  a  value  less  than  1,  regardless  of  the 
false  alarm  probability.  Thus  the  Gaussian  approximation  must  certainly 
deteriorate  for  large  R;  the  exact  discrepancy  for  probabilities  of  practical 
interest  is  displayed  in  figures  12-14. 
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ANALYTIC  RESULTS  FOR  y=0.  SAMPLE  MEAN  NOT  REMOVED 

In  this  section  and  the  next,  attention  will  be  confined  solely  to  the 
case  of  scale  factor  y=0.  The  characteristic  function  of  the  crosscorrelator 
output  q  is  then  given  in  (31)  and  (32),  and  the  mean  and  variance  of  q  are 
listed  in  (33).  Due  to  the  complexity  of  the  exponential  term  in 
characteristic  function  (31),  there  are  no  general  probability  density 
function  or  cumulative  distribution  function  results  for  arbitrary  N,  like 
those  given  earlier  in  (40),  (41),  and  (44)  for  y=1*  Here,  we  can  have  N^l. 

SPECIALIZATION  TO  THE  SIGNAL  AND  NOISE  MODEL 


For  the  model  presented  earlier  in  (3)-(8) ,  the  original  parameters  in 
(24)  take  the  form  already  given  in  (37),  but  now  with  y=0«  Specifically, 
characteristic  function  (31)  is 


exp 


if 


(91) 


where 


Ei  =  2p  (S  S  )^^^,  Eo  =  D  D  +D  S  +D  S  +S  S  (1-p^)  , 

1  ^s'  u  v'  *  2  u  V  u  V  V  u  u  v*"  s'  * 

The  mean  and  variance  of  crosscorrelator  output  q  follow  from  (38)  according  to 

“q  ■  *  “u“v^  ’ 
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NORMALIZED  CROSSCORRELATOR  OUTPUT 


As  in  (49),  and  for  the  same  reasons,  we  define  a  normalized 
crosscorrelator  output,  relative  to  the  additive  random  noise  disturbances 
Uj(n)  and  Vjj|{n)  in  (3)  and  (5),  according  to 


h  = 


m  • 


(94) 


The  characteristic  function  of  h  is  available  from  (91)  and  (92) 


=  1 ,  (95) 

where 

a  -  Ps(R/v)^'^  .  8  -  ’ 

a  =  Nr^r-^,  b  =  |N[(l*R,,)r2  ♦  (HR^)r^  -  .  (96) 

and  where  we  have  defined 

S  S  u  u 

R  _Ji  R  --V  r  .  ^  r  fq?! 

%  "  D  *  %  -  0  ’  ’^U  -  372^  *  "^V  -  pl/2  • 

u  ^v 

The  characteristic  function  in  (95)  depends  on  six  fundamental  parameters, 

namely  N,  r^^,  r^,  r^,  r^.  The  mean  and  variance  of  h  follow  from 
(94),  (93),  and  (97): 
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“h  =  , 

“h  -  .  (98) 

and  Ty  are  referred  to  as  normalized  means. 

REDUCTION  TO  IDENTICAL  SIGNAL  COMPONENTS 


In  order  to  prepare  for  numerical  evaluation  of  the  operating 
characteristics  of  the  crosscorrelator  with  y=0,  we  further  specialize  the 
signal  and  noise  model  to  the  case  where 


Ru  =  R,  =  R,  -  1.  .  r  ; 


(99) 


see  (56)  et  seq.  This  leads  to 


a  =  R»  B  ~  l'*‘R,  a  =s  b  »  Nr  , 

via  (96).  The  characteristic  function  in  (95)  then  reduces  to 


-N/2 


=  [(l-^1?)(l-ir(l+2R))r''"  exp 


and  the  mean  and  variance  in  (98)  become 


i?Nr^  1 

l-iV(  l+2R)  J  ’ 


(100) 


=  N(R+r^),  =  N[l+2R+2R^+2(l+2R)r^] 


(101) 


The  characteristic  function  in  (100)  has  a  branch  point  at^=!  i,  and  another 
branch  point  at  f  =  -i/(l+2R)  which  overlaps  an  essential  singularity;  this 
complicates  some  of  the  analytical  development  to  follow. 


There  are  three  fundamental  parameters  in  (100),  namely  N,  R,  r.  Since 
normalized  mean  r  appears  only  through  its  square,  we  can  presume  r^O  without 
loss  of  generality.  Furthermore,  if  r=0,  characteristic  function  (100) 
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reduces  to  (57)  if  N-1  there  is  replaced  by  N.  Thus  the  curves  for  r*0  here 
can  be  obtained  from  the  earlier  curves  for  in  figures  1-14  by  looking  at 
a  value  for  N  there  which  is  one  greater;  accordingly  we  can  confine  attention 
to  r>0  in  this  and  the  next  section. 

When  the  random  signal  components  u^(n),  V3(n)  in  model  (3)  are 
absent,  then  R=0,  and  the  exceedance  distribution  function  corresponding  to 
characteristic  function  (100)  becomes  the  false  alarm  probability.  However, 
(100)  still  depends  on  r,  meaning  that  the  false  alarm  probability  must, 
likewise.  Thus,  a  non-zero  mean  in  (3),  i.e.  r>0,  is  not  considered  a  signal 
attribute  here,  but  rather  is  a  nuisance  quantity;  it  may,  in  fact,  degrade 
the  operating  characteristics  if  not  removed. 

For  notational  convenience  in  the  following,  we  define 

0)  =  1+2R  .  (102) 

The  magnitude  of  the  exponential  term  in  characteristic  function  (100)  then 
can  be  expressed  as 


(103) 


which  is  monotonically  decreasing  for  | >0.  Coupled  with  the  observation 
immediately  under  (39),  it  is  seen  that  |ff,(f))  in  (100)  is  monotonically 
decreasing  for  all  ^>0  and  any  N,R,r.  This  property  allows  for  a  convenient 
termination  procedure  in  the  numerical  transformation  [3]  of  characteristic 
function  (100).  It  should  however  be  observed  that  (103)  does  not  decrease  to 
zero,  but  saturates  at  value  exp(-  Nr^ ,  regardless  of  how  f  increases  to 
infinity;  thus  the  eventual  decay  of  the  characteristic  function  (100)  is 
furnished  only  by  the  leading  factor. 
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ASYMPTOTIC  BEHAVIOR  OF  CUMULATIVE  AND  EXCEEDANCE  DISTRIBUTION  FUNCTIONS 

In  appendix  E,  it  is  shown  that  if  characteristic  function  (100)  is 
substituted  in  (63)  and  (64),  and  the  cdntours  moved  appropriately  in  the 
complex  "f-p lane,  then  the  following  asymptotic  behaviors  obtain.  The 
cumulative  distribution  function 


P 


h 


2N/2 


exp 


[■ 


Nr 


r^  1 


★ 


Nr^  Y 


as  u->  -00. 


(104) 


We  see  again,  in  similar  fashion  to  (61)  and  (62),  that  in  order  for  the 
correction  term  in  the  second  line  of  (104)  not  to  be  too  significant,  we  must 

p 

have  u  <  -N^.  For  reasons  elucidated  in  (61)  et  seq.,  (104)  is  not  useful 
for  large  N. 


As  checks  on  (104),  we  note  that  for  r^O  and  N=2,  (104)  reduces  precisely 
to  the  upper  line  of  (71);  this  latter  result  pertains  to  y=1»  N=3  and  is 
consistent  with  the  observation  already  made  in  the  paragraph  below  (101).  In 
addition,  if  we  let  r=0  and  Na4  in  (104),  it  reduces  to  the  upper  line  of 
(75);  this  latter  result  holds  for  y=1,  N=5  and  is  likewise  consistent. 


Also  given  in  appendix  E  are  a  variety  of  asymptotic  expansions  for  the 
exceedance  distribution  function;  the  simplest  one  is 


1  - 


Ph('^) 


N-1 


,T-1 


2ir 


1/2  .N/2 


(1+R) 


N/2 


(Nr^)  J 


(1+2R) 


N+1 

"T 


as  u 


+  0*;  r>0  . 


(105) 
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However,  the  same  reservations  as  above,  regarding  u  large  relative  to  N^, 
are  again  in  order. 

DISTRIBUTIONS  FOR  N=1 


If  characteristic  function  (100)  with  N=1  is  substituted  in  (63),  and  if 
the  contour  is  moved  as  indicated  under  (66),  there  follows  the  exact  result 
for  the  cumulative  distribution  function 


+o«> 

r 


dt 


(l+t'')(lMl+t‘')) 


T77 


.i: 


exp|u(l+t  )  - 


r^(in^) 

l+a)(l+t^) 


] 


for  u<0.  (106) 


(This  reduces  to  (67)  for  r=0,  as  it  must.)  This  integral  form  possesses  all 
the  desirable  attributes  listed  under  (67). 


If  characteristic  function  (100)  with  N=1  is  substituted  in  (64)  in  an 
attempt  to  get  the  exceedance  distribution  function,  the  analysis  becomes 
rather  difficult,  due  to  the  overlapping  essential  singularity  and  branch 
point  of  the  integrand  at  5’  =  -i/u.  This  problem  is  treated  in  detail  in 
appendix  F,  with  the  result  that  the  exceedance  distribution  function  can  be 
found  via  the  characteristic  function  approach  in  terms  of  two  integrals;  see 
(F-21)-(F-23).  However,  a  better  numerical  procedure  for  the  exceedance 
distribution  function  is  the  direct  result  derived  in  (F-33);  this  latter 
integral  is  the  one  actually  used  here  to  generate  the  operating 
characteristics  for  y=0,  N»1. 

DISTRIBUTIONS  FOR  N=2 


The  characteristic  function  is  available  from  (100): 


(107) 
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where  u  =  1+2R.  The  probability  density  functions  corresponding  to  these  two 
characteristic  functions  are  [5,  6.631  4] 


Pj(u)  =  exp{u)  U(-u) 


P2(u)  =  i  exp(  U{u)  .  (103) 


where  U  is  the  unit  step  function 


U(u)  = 


0  for  u<0 


1  for  u  >0 

The  probability  density  function  of  h  is  given  by  convolution 


Ph(u)  ==  J dt  pj^(t)  P2(u-t)  for  all  u 
^  06 


(109) 


(110) 


Substitution  of  (108)  in  (110)  yields 


where  the  Q-function  is  defined  in  [7]  and  the  two  integrals  encountered  have 
been  evaluated  by  use  of  [5,  6.631  4]  and  [7,  (9)],  respectively.  The 
cumulative  and  exceedance  distribution  functions  of  h  readily  follow  from 
(111),  the  latter  by  means  of  [7,  (42)]: 
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(As  a  check,  for  r=0,  then  (111)  and  (112)  reduce  to  (70)  and  (71) 

respectively,  as  they  must.) 


DISTRIBUTIONS  FOR  N=4 

The  characteristic  function  is  available  from  (100): 

f^(r)  = 

where  u  =  1+2R.  The  probability  density  functions  corresponding  to  these  two 
characteristic  functions  are  [5,  6.631  4] 


P^(u)  =  -u  exp(u)  U(-u)  , 


P2{u) 


(114) 


The  probability  density  function  of  h  is  given  by  convolution  (110).  In 
preparation  for  that  result,  we  use  the  shorthand  notation 


(115) 
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where  the  Qj^-function  is  defined  in  [8].  We  also  present  a  new  integral 
result  that  will  be  needed  in  the  sequel, 

r  dx  X  Qn^(b,  ax)  «  ^^b^Q^^^(b,ac)+2M  Q,^(b.ac)-a^c^Qj^_j(b,ac)],  (116) 

which  can  be  interpreted  as  the  limit  of  [8,  (31)]  as  p'*0+.  Substitution  of 
(114)  in  (110)  yields  probability  density  function 


for  u  <  0 


Ph(u) 


(117) 


— j  exp^  -  ^^^r^q2(u)+2a)(l+(i))q2(u)-(l+a))^uq^(u)J  for  u  >  0 


where  (115)  has  been  used;  the  upper  line  employed  [5,  6.631  4],  while  the 
lower  line  used  (116)  and  an  integration  by  parts  procedure  to  be  elaborated 
below  ii  the  exceedance  distribution  function  evaluation. 


The  cumulative  distribution  function  for  u  £  0  follows  readily  by 
integration  of  (117): 

Pj^(u)  = -——jj  exp^  -  j^jJ^r^+(l+a>)(l+3a>)-(l+(i))^uJ  for  u  <  0.  (118) 

For  u  >  0,  a  modified  approach  is  required.  Integration  of  (110)  yields 
cumulative  distribution  function 

4«» 

P.(u)  =  r  dt  P2(t)  p2(u-t)  .  (119) 

Probability  density  functions  Pj^  and  P2  are  available  in  (114),  and 
cumulative  distribution  function  Pj  follows  as 
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Pl{u)  = 


(l-u)exp(u)  for  u  <  0 


1  for  u  >  0 


(120) 


Substitution  of  (114)  and  (120)  in  (119)  yields,  for  u  0, 

+« 

J 2^  exp^  ^  t^^^  I^^4rt^^y(o)  (1-u+t)  exp{u-t)  = 
u 

+«# 

=  l-q2(u)  +  ^  exp^-  Jdt  t^^^  exp^  t  ^Ii(4rt^^Y“)  (121) 


via  [8,  (22)].  We  now  integrate  by  parts,  letting  U(t)=:l-u+t,  and  the 
remainder  dV(t).  Then  using  [8,  (22)]  again,  we  find 


71^ '’‘’’fey  ■ 


(1+0))^  ^ 

Combining  these  results,  (121)  and  (116)  yield 

1  -  P^,(u)  =  q2(u)  -  exp^u  -  q2(u)  -  Jdt  q2(t)  = 

=  q2(u)  -  - -4:  exp^  -  jJ|;j-j[4r^q3(u)+(l+a))(l+3u))q2(u)-(l+a»)^uqj(u^ 


(122) 


for  u  >  0.  (123) 


42 


TR  7045 


The  final  results  for  N=4  are  given  by  (115),  (118),  and  (123).  This  case  was 
used  as  a  numerical  check  on  the  computational  approach  [3]  proceeding 
directly  from  characteristic  function  (100)  to  the  exceedance  distribution 
function,  with  excellent  agreement  for  numerous  values  of  R,  r,  and  u. 


43/44 

Reverse  Blank 


TR  7045 


GRAPHICAL  RESULTS  FOR  y=0.  SAMPLE  MEAN  NOT  REMOVED 

SUMMARY  OF  PARTICULAR  CASE  CONSIDERED 

The  situation  of  interest  has  already  been  summarized  in  {76)-(78);  in 
addition,  we  have  a  common  value  for  the  normalized  means. 


(124) 


and  the  normalized  crosscorrelator  output  is  not  {79)-(80),  but  rather  is,  for 

T=0, 


h  = 


1 


(D  D  , 

'  u  v^  n=l 


%  \\  ■ 


(125) 


The  characteristic  function  is  given  by  (100): 


f^(f)  = 


(126) 


where  u  =  1+2R.  When  the  signal  is  absent,  then  R=0;  however  the  false  alarm 
probability  corresponding  to  this  characteristic  function  still  depends  on  r. 
Thus  since  the  sample  mean  has  not  been  removed,  the  operating  characteristics 
will  also  depend  on  r.  Since  results  for  r^O  can  be  found  from  an  earlier 
section,  we  only  consider  r>0  here. 


OPERATING  CHARACTERISTICS  FOR  y=0 

A  sample  program  for  evaluation  of  the  cumulative  and  exceedance 
distribution  functions  corresponding  to  characteristic  function  (126),  and 
thereby  the  detection  probability  vs.  false  alarm  probability  operating 
characteristics  of  the  crosscorrelator  without  sample  mean  removal,  is  given 
in  appendix  G.  In  figures  15-35  are  presented  the  operating  characteristics 
for  values  of 

p«ii«  Se®. 
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N  =  1.  2,  3,  4,  8,  16,  32,  64,  128,  256,  (127) 

and  for  various  values  of  r.  The  case  of  N=1  was  accomplished  by  use  of  (106) 
and  (F-33);  results  for  N=2  employed  (112);  and  the  remainder  for  employed 
a  numerical  procedure  [3]  proceeding  directly  from  characteristic  function 
(126)  to  the  exceedance  distribution  function.  False  alarm  probabilities  Pp 
in  the  range  lE-10  to  .5  and  detection  probabilities  Pg  covering  lE-10  to 
.999  are  presented.  The  abscissa  and  ordinate  on  these  plots  employ  a  normal 
probability  transformation,  as  explained  earlier  in  (84)-(86). 

Values  of  signal-to-noise  ratio  R  are  taken  as  8=2*^,  where  n  assumes 
values  appropriate  for  each  plot  in  order  to  cover  the  full  range  of 
probabilities  of  interest.  Values  of  normalized  mean  r  in  (124)  have  been 
taken  as  r=l  and  2,  with  the  exception  of  figure  19  where  one  example  for  r=4 
was  added. 

Without  exception,  increasing  r  from  zero  degrades  the  operating 
characteristics  of  the  crosscorrelator.  For  example,  figures  17,  18,  19  give 
a  succession  of  operating  characteristics  for  r  »  1,  2,  4  respectively,  and 
for  common  values  of  signal-to-noise  ratio  R.  (in  order  to  determine  the 
operating  characteristics  for  r=0  here,  we  can  look  at  the  earlier  results  in 
figures  1-14,  but  for  a  value  of  N  which  is  one  greater  there.)  Thus,  not 
removing  the  sample  mean  from  the  crosscorrelator  output  requires  a  larger 
threshold  setting  for  a  specified  false  alarm  probability  and  thereby  lowers 
the  detection  probability  and  degrades  performance. 

GAUSSIAN  APPROXIMATION 

If  the  crosscorrelator  output  is  Gaussian,  for  both  signal  absent  as  well 
as  present,  the  earlier  derivations  in  (83)-(86)  pertain.  Now  reference  to 
(101)  yields  statistics 


mg  =  Nr^,  m^  =  N(R+r^)  , 

=  N(l+2r^),  oj  =  N[l+2R+2R^+2(l+2R)r^], 


(128) 
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since  setting  signal-to-noise  ratio  R=0  corresponds  to  hypothesis  0,  signal 
absent.  Substitution  in  (86)  yields  the  normal  probability  approximation 


1/2  2 

R+(l+2r'^)  X 

- 2 

[1+2R+2R  +2(l+2R)r^] 


(129) 


These  straight  lines  are  superposed  as  dashed  lines  in  figures  32-35  for  N=128 
and  256.  The  Gaussian  approximation  is  moderately  good  for  large  N  such  as 
256,  and  in  fact  crosses  the  exact  curves  (solid)  at  a  point  which  is  labeled 
with  the  corresponding  value  of  n  in  signal-to-noise  ratio  R=2^. 


An  obvious  shortcoming  of  the  Gaussian  approximation  (129)  is  apparent: 


lim  y 

R-*«a 


for  any  x,  r  . 


Reference  to  (85)  then  yields  the  interpretation 


lim  P 
R-*«> 


D  “ 


< 


1 


for  any  Pp,  r  . 


(130) 


(131) 


That  is,  as  input  signal-to-noise  ratio  R  tends  to  infinity,  the  approximate 
detection  probability  saturates  at  a  value  less  than  1,  regardless  of  the 
false  alarm  probability  and  normalized  mean  r.  Thus  the  Gaussian 
approximation  must  certainly  be  inaccurate  for  large  R;  the  exact  discrepancy 
for  probabilities  of  practical  interest  is  displayed  in  figures  32-35. 
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SUMMARY 

A  closed  form  expression  for  the  characteristic  function  of  the  output  of 
a  crosscorrelator,  with  or  without  sample  mean  removal,  has  been  derived  in 
(23)-(24)  for  general  values  of:  the  number  of  terms  added  to  yield  the 
correlator  output,  the  means  and  variances  in  each  of  the  two  input  channels, 
the  degree  of  correlation  between  the  two  channels,  and  the  scale  factor 
employed  in  the  sample  mean  removal.  A  program  for  the  evaluation  of  the 
cumulative  and  exceedance  distribution  functions  of  this  general  case  has  also 
been  presented.  These  results  can  furnish  the  basis  of  a  study  of  the  error 
probabilities  of  a  correlator  required  to  decide  between  alternative 
hypotheses  on  the  input  statistics  [1];  this  problem  will  in  fact  be  the 
subject  of  a  future  technical  report  by  this  author. 

The  general  results  were  first  specialized  to  a  signal  and  noise  model, 
and  then  to  the  two  distinct  cases  of  sample  mean  removal  (y=1)  af'd  no  sample 
mean  removal  (y=0).  Plots  of  the  operating  characteristics  for  numerous 
values  of  N  and  signal-to-noise  ratio  R  were  then  displayed  for  a  wide  range 
of  detection  probability  vs  false  alarm  probability.  Some  new  analytic 
results  for  cumulative  and  exceedance  distribution  functions,  especially  for 
small  N,  were  derived  and  used  as  checks  on  the  general  numerical  procedure. 
Comparisons  with  a  Gaussian  approximation  indicated  quantitatively  when  that 
simplification  is  valid.  Asymptotic  results  derived  were  useful  for  small  N, 
but  not  for  large  N  except  in  the  region  of  probabilities  too  small  to  be  of 
practical  importance. 
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Figure  2.  Operating  Characteristics  -for  Cross- 
Correlator  with  Sample  Mean  Removal,  N  3 
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Figure  3.  Operating  Characteristics  -for  Cross- 
Correlator  with  Sample  Mean  Removal,  N  •=  4 

53 


Fits 


-10  lE-8  lE-G  lE-4  .001  .01  .1 


Figure  5.  Operating  Characteristics  for  Cross 
Correlator  with  Sample  Mean  Removal,  N  »=  8 
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Figure  7.  Operating  Characteristics  for  Cross- 
Correlator  with  Sample  Mean  Removal,  N  “  16 


Figure  8.  Operating  Characteristics  -for  Cross 
Correlator  with  Sample  Mean  Removal,  N  «=  2^ 
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Figure  10.  Operating  Characteristics  for  Cross 
Correlator  with  Sample  Mean  Removal,  N  ■  48 
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Figure  11.  Operating  Characteristics  for  Cross 
Correlator  with  Sample  Mean  Removal,  N  *  64 
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Figure  12.  Operating  Characteristics  for  Cross- 
Correlator  with  Sample  Mean  Removal,  N  •=  96 
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Figure  13.  Operating  Characteristics  for  Cross 
Correlator  with  Sample  Mean  Removal,  N  ■*  120 
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Figure  14.  Operating  Characteristics  for  Cross- 
Correlator  with  Sample  Mean  Removal,  N  -  356 
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Figure  16.  Operating  Characteristics  for  Cross- 
Correlator  without  Sample  Mean  Removal,  N“1 ,  r-2 
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Figure  17.  Operating  Characteristics  for  Cross- 
Correlator  without  Sample  Mean  Removal,  N«=2 ,  r»»l 
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Figure  18.  Operating  Characteristics  for  Cross 
Correlator  without  Sample  Mean  Removal,  N-2 ,  r" 
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Figure  19.  Operating  Characteristics  for  Cross 
Correlator  without  Sample  Mean  Removal,  N-2 ,  r« 
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Figure  21.  Operating  Characteristics  for  Cross- 
Correlator  without  Sample  Mean  Removal,  N"*3 ,  r“2 
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Figure  22.  Operating  Characteristics  for  Cross- 
Correlator  without  Sample  Mean  Removal,  ,  r“l 


Ffgure  23.  Operating  Characteristics  for  Cross- 
Correlator  without  Sample  Mean  Removal,  N"‘4 ,  r“2 
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Figure  24.  Operating  Characteristics  for  Cross 
Correlator  without  Sample  Mean  Removal,  N-S ,  r> 
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Figure  25.  Operating  Char acter i st i cs  for  Cross- 
Correlator  uiithout  Sample  Mean  Removal,  N-'S ,  r»2 
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Figure  26.  Operating  Characteristics  for  Cross 
Correlator  without  Sample  Mean  Removal,  N**16,  r 
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Figure  27.  Operating  Characteristics  for  Cross 
Correlator  without  Sample  Mean  Removal,  N*16,  r 
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Figure  29.  Operating  Characteristics  for  Cross- 
Correlator  without  Sample  Mean  Removal,  r*»2 
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Figure  31,  Operating  Characteristics  for  Cross- 
Correlator  without  Sample  Mean  Removal,  N“64 ,  r-2 


Figure  32.  Operating  Characteristics  -For  Cross- 
Correlator  without  Sample  Mean  Removal,  N*»128,  r® 
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Figure  33.  Operating  Char acter I st 1 cs  for  Cross 
Correlator  without  Sample  Mean  Removal,  N«=128,  i 
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Figure  34.  Operating  Characteristics  for  Cros 
Correlator  without  Sample  Mean  Removal,  N"256, 
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Figure  35.  Operating  Characteristics  For  Cross- 
Correlator  without  Sample  Mean  Removal,  N-*25B, 


TR  7045 


APPENDIX  A.  CORRELATOR  OUTPUT  INDEPENDENCE  OF  MEANS 

If  we  let  scale  factors  o=l  but  in  (11),  we  still  get  y«1  from  (13). 
This  means  that  correlator  output  q  in  (12)  is  independent  of  b. 

To  see  this  directly,  let 

^n  =  ^^u  ^n*  ''n  ~  ^  ^n  *  (A-1) 


where  means 


^  ^  =  0  • 

Then  (11)  yields,  with  a=l, 

N 

%  =  I'n  -  I  2 

m»l 

which  is  obviously  independent  of  the  actual  value  of  mean  Also,  (11) 
yields 


V 


n 


My(l-B)  . 


{A-4) 


which  still  depends  on  and  b.  When  (A-4)  is  substituted  in  (12),  we  get 
correlator  output 


(A-51 


But  since 


N 

S  =  0  (A-6) 

n=l  " 


A-1 
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from  (A-3),  (A-5)  reduces  to 

N 


n=l 


N 

n=l 


N_ 

> 

m=sl 


N  N  N 

n=l  m=l  n=l 


{A-7) 


in  terms  of  the  ac  components  defined  in  (A-1)  and  (A-2).  Correlator  output 
(A-7)  is  obviously  independent  of  means  My,  and  scale  factor  g  in  (11). 
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APPENDIX  8.  A  USEFUL  INTEGRAL  OF  EXPONENTIALS  OF  MATRIX  FORMS 

For  si^etric  KxK  matrix  M,  with  det  M>0,  the  following  K-fold  integral 
is  well  known  (see  for  example,  [9,  section  8-3]): 


J dX  exp[-  ^x'^'mX+N^X]  =  exp^^  n'^M'^nJ  . 


(B-1) 


Here  X  and  N  are  Kxl  column  matrices.  We  wish  to  extend  this  result  to  the 
case  of  double  integral 

I  =  (27r)~*^  jJ'dU  dV  exp^-  ~  U^AU  -  |  V^BV  +  U^CV  +  D^U  +  E^V^  ,  (8-2) 

where  A  and  B  are  symmetric  without  loss  of  generality,  and  the  integral 
converges;  here,  matrices  A,  B,  C  are  KxK  while  U,  V,  D,  E  are  Kxl.  Notice 
that  if  we  had  the  apparently  more-general  term 

U^C^V  +  V^C2U  =  U^{C^  +  C2)V  ,  (B-3) 

we  would  simply  let  C  =  Cj^  +  C^,  and  thereby  immediately  have  form  {B-2). 

To  accomplish  the  evaluation  of  I  in  (B-2),  identify  M  =  B,  N^  U^C  +  E^, 
X  =  V  in  (B-1),  and  thereby  evaluate  the  V-integral  in  (B-2),  with  result 


n  -  K~^^^  r  T 

•••  =  [dif^J  exp[|(u'^C  H-  E^)B-^(C^U  +  E^  . 

Substituting  (B-4)  in  (8-2),  regrouping,  and  using  the  symmetry  of  B  (and 
therefore  B“^),  there  follows 


(B-4) 


I  = 


ihl 


-K/2 


(det  8) 


T72 


JdU  exp  p  I  U^(A-CB“^C^)U  +  (dW8“^C^)U  +  i  eV^e]  .  (B-5) 
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Now  reemploying  (B-1)  with  identifications  M  =  A  -  N  =»  0  ^  CB~^E, 

X  =  U,  we  get  a  closed  form  result  for  (8-5): 

I  =  [det(AB  -  CB~^C^B)j  exp||  eV^E  + 

+  |•(D+CB~^)^{A-CB■^C^)~^(0+CB"^E)].  (B-6) 

This  is  the  desired  general  result  for  integral  (B-2). 

As  an  aside,  there  is  probably  a  more  symmetric  closed  form  result  than 
(B-6),  since  if  we  represent  (B-2)  by  I(A,  B,  C,  0,  E),  we  quickly  see,  by 
interchange  of  dummy  variables  U  and  V,  that 

I(A,  8,  C,  D,  E)  =  I(B,  A,  C’*',  E,  D).  (B-7) 

However,  we  have  not  discovered  the  symmetric  form  of  (B-6).  The  present  form 
follows  as  a  result  of  the  sequential  integration  of  {B-2),  first  on  V,  then 
on  U. 
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APPENDIX  C.  PROGRAM  FOR  CUMULATIVE  AND  EXCEEDANCE  DISTRIBUTION 
FUNCTIONS  VIA  CHARACTERISTIC  FUNCTION  (23)-(24). 


The  numerical  procedure  employed  in  appendices  C,  D,  and  G  here  is 
heavily  based  on  [3].  The  choices  of  L,  a,  b  in  lines  90  to  110  to  control 
truncation  error  and  aliasing  are  also  made  according  to  the  method  of  [3]. 
The  parameters  in  (24)  are  evaluated  once  in  lines  210-260  so  as  to  minimize 
computation  time.  The  FFT  subroutine  used  in  lines  1030  et  seq  is  listed  in 
[3,  pp.  B-11  -  B-12],  and  employs  a  zero-subscripted  array.  A  sample  plot  of 
the  cumulative  and  exceedance  distribution  functions  follows  the  program. 


10  !  CROSS-COPRELUTOP  WITH 

20  H  =  5 

30  Ganima=.5 

40  Mu=-.4 

50  = .  3 

60  Su=.7 

70  S 

80  R  h  C‘  = .  6 

80  L=60 

100  He’ t  .a=.  12 

110  Es=.  25-^ 2*R I De  1  t  a> 

120  Mf  =  2'-S 


SfiMPLE  MEmN  REMOVRL;  HUSC  TR  7045 
!  Hurnb€»'  of  ■*  s-rrir*  s-ur.itutd  t  o  yit  ld  ootput 
!  Scale  factor  i  ri  saniple  rue  ao  r  erfiO''al 
!  U  char'inel  mean 

!  V  chanriel  mean 

!  U  chartnel  standard  deoiatioti 

!  V  channel  statidard  deoiation 

!  Corre 1 ^t i on  c  oe  f f i c i e  nt 
!  L  i  trt  i  t  o  n  i  n  t  e  g  r  a  1  o  f  c  h  ar  .  f  u  r'l  c  t  i  o  r'i 
!  Sam  pH  rig  increment  on  char,  function 
!  Shift  b,  as  fraction  of  alias  interoa.! 
‘  Size  of  FFT 


130  PRINTEi^  IS  0 

140  PRINT  "L  =";L, "Delta  = " ; De 1 t a, "b  =";Es,"Mf  =";Mf 
150  P  E  D I M  K  <  0 :  t1  f  -  1  ■' ,  Y  <  0 ;  M  f  - 1  > 

160  DIM  K  <  0 :  1 023 > , V ' 0 : 1 023  > 

170  Su2  =  Su  *  S  M  !  C  a 1 c  u I  at  e 

1 S  0  S  o  2 = S  o  *  S  V  !  p  ar  am  e  t  e  r  s 

190  T  1  =  1  ~  ij  aiii  m  a 


200 

210 

220 

230 

240 

250 

260 

270 

280 

290 

300 

310 

320 

330 

340 

330 

360 

370 

380 

390 

400 


T2=T1*T1 
E 1  =2'*Rho*Su*S‘-.‘ 

E  2  =  S-  u  2  S  y  2  ( 1  R  fi  o  Fl  h  o  > 

F1=E1»T1 
F2=E2*T2 
Gl=H*Mu--My*Tl 

G  2  =  •  5  *  H  *  (.  S  u  2  *  N  y  *  M  m  +  S  y  2  *  M  u  *  M  u  -  E 1  *  M  u  *  M  m  :•  *  T  I 
Nl  =  .  5*'::N-1  ;■ 

M  u  q  =  I  j  1  +  <  N  -  G  a  ri  i  ri  t  a  >  *  R  h  o  *  S  u  *  S  '•.* 

Muy=Muq+Es 
K‘;G.:'-0 

Y  <  0  >  = ,  5  #  D  e  1 1  a + M  u  y 
FOR  Hs^l  TO  lHT<;L/DeUa:> 

X  i  —  D  e  1 1  a'it  H  s 
K2=X i *X i 
Tl=-Xr*Fl 
T2= 1+X2*F2 

CALL  D  j  M<  -  X2t:  G2 ,  X  i  *G1 ,  T2,  T 1 ,  fl,  B) 

CALL  Log(  l+X2'eE2,  -Xi-sf-El^CjD) 

COLL  Log>::T2,  T1 ,  E,  F> 

CftLL  Exp  <■  Fl-Nl  *C- .  5*E ,  E-H 1  *D- .  5*F  +  X  i  *E's  ,  Fyr ,  Fy  i  > 


Mean  of  random  ','ar  iable  q 
Mean  of  shifted  oar  sable  v 


fir  guru ent  xi  of 
Cal  c  u  1  at  i  on 
of 

char  act er  i  st  i  c 
f unc  t i on 
fyCxi  > 


c  I'lar  .  f  i-inc  t  i  o 
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410  r-l£=Ns  MOD  Mf 
420  K  <  M s  >  =  K <■  M s  >  +  F m r-  Ns 
4  3  0  Y  <  M  s  >  -  Y  M  s  >  +  F  y  i  -  N  s 

440  NEXT  Ns 

450  CRLL  Fft  ilf  ,Xv*),Y';*>> 

460  PLOTTER  IS  "GRRPHICS" 

470  GRAPHICS 

480  SCALE  e,Mf,-14,e 

490  LINE  TYPE  3 

500  GRID 

510  PENUP 

520  LINE  TYPE  1 

530  B  =  Es*Mf  *De  1 1  a-  <2*PI  > 

540  MOVE  B,0 

550  DRAW  B,-14 

560  PENLIP 

570  FOR  Ks  =  0  TO  Mf-  1 
5S0  T  =  Y<.Ks>--PI-Ks--Mf 
590  X(:Ks>  =  .  5-T 
600 
610 
620 
630 
640 
650 
660 
670 
680 
690 
700 
710 

720  IF 

730  PLOT  Ks,Y 

740  NEXT  Ks 

750  PENUP 

760  PAUSE 

770  DUMP  GRAPHICS 

780  PRINT  LIN'::5> 

790  PRINTER  IS  16 

800  END 

810  ! 

820  SUE  Diy':Xl,Yl.X2,Y2,A,B> 

830  T=X2*X2+Y2*Y2 

840  A=<Xl»X2  +  Yl»Y2:j  ■  T 

850  B  =  <  Y 1  ♦X2-X 1  *  V2  )  '•  T 

860  SUBEND 

870  ! 

880  SUB  LogCX,  Y,  A,  B:* 

890  A=. 5*L0G<X*X+Y*Y> 

900  IF  X<>0  THEN  930 

910  B*.  5*Pi»SGtUY;' 

920  GOTO  950 


L'o  I  1  aps  i  ritj 


!  0  subscript  FFT 


Origin  for  randorn  yariable  q 


!  Curnu  1  at  i  ye  pr  ob  ab  H  i  t  y  in  X ' 

!  Exceedance  probabiHis'  »n  Y'* 

Pr  ) 


!  21 '22 


!  PRINCIPAL  LGG<2> 


Y(Ks)=Pr=.  5+T 

IF  Pr>=lE-12  THEN  Y=LGT<Pr> 

IF  Pri=-lE-l?  THEN  V=-24-LGT 
IF  ABS<Pr><lE~12  THEN  Y=-12 
PLOT  Ks,Y 
NEXT  Ks 
PENUP 

PRINT  Y  0  ;  Y  ■  :  1 ) ;  Y  <  M  f  -  2  >  ;  Y  •;  M  f  - 1 
FOR  Ki-O  TO  Mf-l 
Pr=X  <  Ks ) 

IF  Pr>=lE-12  THEN  Y=LGT<Pr> 

IF  Pr<=-1E-12  THEN  Y=-24-LGT OPr > 
ABS<Pr><lE~12  THEN  Y»-12 


930  B=ATH<Y-'X) 

940  IF  X<;0  THEN  B  =  B  +  PI*a-2*<Y<0)  > 
950  SUBEND 
960  ! 
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9?0  SUB  Exp(X,Y,fl,E>  !  EXPCZ.J 

980  T  =  EXP<;X> 

990  fl  =  T*COS':Y:) 

1000  b=t*siH':y> 

1010  SUBENB 
1020  ! 

1030  SUB  Fft  102':;N,  >  !  N  <=  2'10  =  1024,  N  =  2"  INTEGER  0  SUBSCRIPT 
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origmfor  sHifted  variable 


exceedance 
,  distribution 


cumul itive 
distribution 


L=60 

a=.12 


Neciatnve  Probibil  ities 


Figure  C- 1 . 


Cumulative  and  Exceedance 
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APPENDIX  0.  PROGRAM  FOR  EVALUATION  OF  OPERATING 
CHARACTERISTICS  FOR  y“1 

The  comments  in  appendix  C  are  relevant  here  also.  The  characteristic 
function  used  as  the  starting  point  is  given  by  (81).  Sampling  increment  & 
employed  on  the  characteristic  function  can  be  coarse  for  small  signal-to-noise 
ratio  R,  but  must  be  finer  for  larger  R.  The  quantity  DeltaO,  in  line 
30  is  that  used  for  R=0;  all  other  &  values  are  sub-multiples,  as  indicated  by 
lines  110-130.  A  table  follows. 


N 

4 

6 

8 

12 

16 

24 

32  48 

64 

96 

128 

256 

.10 

.09 

.08 

.06 

.05 

.05 

.05  .05 

.04 

.03 

.03 

.02 

Table 

D-1. 

Values 

of  Aq  for 

Y=1 

Let  Aj  denote  the  sampling  increment  employed  for  a  particular  value  of 
signal-to-noise  ratio  R2^>0.  The  cumulative  and  exceedance  distribution 
function  values  are  available  at  spacing  s  =  2ir/(M^A)  in  general,  where  Mf 
is  the  FFT  size.  If,  for  example,  a^  -  then  s^  =  2sq,  meaning 

that  probability  values  occur  twice  as  coarsely  for  R^  as  for  R=0.  Then  in 
order  to  plot  detection  probability  Pq  vs  false  alarm  probability  Pp 
without  interpolating  points,  it  is  necessary  to  skip  every  other  Pp  point 
available,  and  only  plot  those  Pp,  Pq  pairs  corresponding  to  the  same 
threshold.  More  generally,  if  A|^  =  Aq/K,  where  K  is  an  integer,  then 
Si  =  Ksq,  and  we  plot  only  every  K-th  point  of  the  available  Pp  values. 

Here  we  have  chosen  K  to  be  a  power  of  2,  for  the  purpose  of  ease  of  plotting. 

We  choose  bias  (shift)  b  in  line  in  order  to  give  a  random  variable  y 
which  is  virtually  always  positive  for  R=0;  see  [31.  We  then  keep  b  fixed  as 
R  increases,  which  makes  the  probability  of  y>0  even  greater.  This  feature  of 
choosing  the  same  b  for  all  R^O  enables  an  easy  comparison  of  Pq  and  Pp, 
since  common  threshold  values  are  then  conveniently  realized. 
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It  was  observed  under  (ZJ)  that  the  characteristic  functions  (39)  or  (81) 
have  monotonically  decreasing  magnitudes  for  all  This  makes  the  choice 

of  L,  the  truncation  value  on  the  characteristic  function  integral  in  (63)  or 
(64),  rather  simple;  all  we  need  to  do  is  monitor  /f|^(?)j  of  (81)  until  it 
decreases  below  a  tolerance,  here  taken  as  lE-12.  There  is  no  :rial-and-error 
procedure  required  as  in  [3]  to  guarantee  negligible  truncation  error. 


Subroutines  Exp  and  Log  have  already  been  listed  in  appendix  C,  and  so 
are  not  relisted  here. 

10  '  GrtMMfl  =  1  ShMFLE  HEflM  PFMOVftL 

20  '  N,  Nufiiber  of  ter  mi  i  urn  rued 

30  lie  1  t  iO"  .  O’;  I  Initial  delta 

40  B£  =  P  I  re  1 1  aO  !  E 1  as  b 

50  Mf=2  10  '  Size  of  FFT 

SO  OUTPUT  0;'’GhMMH  =  I";"  H  =“:Hc 

73  OUTPUT  0;“" 

80  DPTh  -2  ,  -  1 . 0,  .  5 .  1  ,  1 . 5 , 2, 2. 5,  3,  3. 5, 4, 5 
80  PtrtL  Us  ‘  '  I  S.NP  R  =  2  ti 

100  OUTPUT  0;Hi'.:*>; 

110  IiPTP  1 , 2, 2, 2, 4, 4, 4, 8, 8,  16,  1 6,  ’32, 64 
I  ’2  0  R  E  P  D  I  d  e  1 1  a '  ♦  > 

130  MPT  De  1 1  aa De  t »  aO  :•  ■■  I  de  1 1  a 
140  OUTPUT  OlDelta- >>; 

150  DPTP  lE-10, lE-8, lE-8, lE-7, lE-6, lE-5, lE-4, . OOl , . Ol , . 1 , . 5, . 8, . 88, . 888 
160  PEP  Ii  c  '  ‘ 

170  DIM  Hi  ■:  1  :  12  J  .  Id-^  1  t  a' 0:  12^  ,Del  tatO:  12  ' ,  Sc  <  1  ;  14) 

180  DIM  X'  O;  8  181  ' ,  '  01  ^  l'?l  ^ 

180  FOR  1=1  TO  14 

200  Sc  •'  1  ■■=FMI-v'pi'.  ■  -  Sc  ^  I  >  > 

210  NEXT  I 

220  S  =  Sc(l'.' 

230  B  =  Sc(;i4’ 

240  Seal  e=  •:  B-S  ‘  ■  '  0  -S  ' 

250  XI =30 

260  X2=iro 

270  Yl=35 

280  V2  =  Y  1  +  < :  :2-X  1  >  tS'-  al  e 

280  PLOTTER  IS  "s8:2P" 

300  LIMIT  XI,  X2 ,  i'  1  ,  I  2 
310  OUTPUT  705; "VS3" 

320  SCPLE  S,0,S,B 
330  FOR  1=1  TO  14 
340  MOVE  S,Sc(;i> 

350  DRPN  0,Sc':i> 

360  NEXT  I 

370  FOP  1=1  TO  11 
380  MOVE  Sc':I:’,S 

380  DRPW  ScD.B 

400  NEXT  I 

410  MOVE  S,S 

420  DRPW  0,0 

430  PENUF 
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440 

Nl=Mf-l 

450 

M2=Mf • 2 

460 

FOR  ln=0  TO  12 

470 

IF  In  0  THEN  500 

480 

Rc  =0 

490 

GOTO  510 

500 

R  c  =  2  N  s  I  n  ) 

!  SNR  R=2  n 

510 

OUTPUT  0;"R  Rc," 

Delta  = " ; De 1 t a< I n ' 

520 

ASSIGN  #1  TO  "AESCIS" 

!  Tempo r  ar y  s  t  o r  age  f  o r 

530 

Del  t  a=  Dc  1  t  a';  I  n  ■■ 

!  false  al arm  probability 

540 

R2=^P.: 

550 

R21=R2+1 

560 

N 1  2  =  <  N  c  -  1  >  ■■■■  2' 

570 

Mux  =  <  Nc - 1 >  *Rc 

!  Mean  of  random  oar i able 

580 

Muv=Mux+Bs 

!  M e  an  of  s h  i  f  t  e d  ■  ar  i  ab  1  e 

590 

REDIM  X<0:  Ml  >  ,  Y-:  0:  Ml  > 

600 

MAT  .<,  =  2hK 

610 

MAT  Y=2ER 

620  X<0>=0 

6  3  0  y  <:  0  :>  = .  5  *  D  e  1 1  a  -  n  u  y 

640  Ls=0 
650  Ls=L£+1 

660  X i  =rie  1 1  a*Ls  !  flrgumert  xi  of  char.  fn. 

670  CALL  Log  ■' 1 +Xi  «X  i  *R21 , -Ki  *R2,  Ri  ,  E  i  >  !  C  al  c  o  1  at,  i  on 

680  CALL  £:•  fj '! -N 1  2*-A  i  ,  K  1  *Es-Nl  2*Bi  ,  Fyr ,  Fy  1  >  !  of 

690  M  £  =  L  s  M  0  D  M  f  !  c  h  ar  ac  t  e  r  i  s  t  i  c 

700  Ar=Fyr'L£  !  funct ion 

710  Ai=Fy7  L-  !  fy(':i> 

720  X<M£>=>;(Ms)+Ar 

730  Y<M£>=y'i  M'r  >+Ai 

740  Mag£q=Af -^Ar  +  A  1 1 

750  IF  Mag=q>lE-24  THEN  650 

760  OUTPUT  y;"Xi  =";Xi;"  Mag  =" ; SQR<Mag£q> 

770  CALL  Ff  1 1  CzuMf ,  X<  *) ,  Yi;;*>  > 

780  FOR  M£=--e  TO  Ml 
790  T  =  Y’.M£>  PI-tla/Mf 

800  X(f1s>  =  .5-T  !  Cumulati'"®’  distribution  function 

810  Y<M£>=.5+T  !  Exceedance  distribution  function 

820  NEXT  Ms 

830  OUTPUT  0  ;  Y  f  0  1  ;  Y  -r  1  >  ;  Y  <  M  1  - 1  >  ;  Y  <  M 1  > 

840  PLOTTER  IS  "CRAPHICS" 

850  GRAPHICS 

860  SCALE  0,Nf,-14,0 
870  LINE  TYPE  3 

880  GRin  Mf.  S.l 

890  PENUP 

900  LINE  TYPE  1 

910  FOR  M£=3  rO  Ml 

920  Pr  =  Y(:Ms:' 

930  IF  Pr>=lE-12  THEN  Y  =  LGT<;Pr> 

940  IF  Pr<=-iE-12  THEN  Y  =  -24-LGT<:-Pr  > 

950  IF  RES(Pr><lE-12  THEN  Y=-12 
960  PLOT  M£,Y 

970  NEXT  Ms 

980  PENUP 
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99ti  FOR  Mi.  =  Ci  TO  Ml 
1000  pr=y‘Ms* 

1010  IF  Pr  =1£--12  THtH  i^LGKPr:. 

1020  IF  Pr<=-1E-12  THEN  V=-24-LGT< -Pr > 

1030  IF  RI:3' Ft  :'  :iE-12  THEN  Y=-12 
1040  PLOT  ru. ,  ' 

1050  NEXT  Mi 
1060  PENUP 
10?0  HUMP  GF;ftPHIC3 
1080  OUTPUT  O;"" 

1090  IF  ln>0  THEN  5200 
1100  FOR  M£=M2  to  Ml 
1110  IF  V<:M;'.  =0  THEN  ll  30 
1120  NEXT  N= 

1130  M3=Ms-l 

1140  REDIM  :;'  M2:H3.' 

1150  FOR  H;=M2  TO  N3 
1168  X  <;  M  5  :■  =  F  N 1  r  i  u  phi';  T  (  M  i  ■  > 

1170  NEXT  Ns 

1  1 80  PR  I  NT  #  1 ;  X  •;  *  .1  t  8t  ore  f  al  se  ^5  arm  pr  ob  ab  i  1  i  t 

1190  GOTO  1330 
1200  REDIM  X';M2:N3> 

1210  REfiD  4i,Xv».>  !  Read  in  false  alarin  probabiliiy 

1220  Id=Idel  ta'.  In> 

1230  J2  =  M2.-'Id 
1240  .J3=lNT':H:!''Id>  +  l 

1250  FOR  J=J2  TO  J3 
1  260  Y  <  J  )  =FN  I  n  'ph  i  <  V  ',  J  ^  > 

1270  NEXT  J 

1230  PLOTTER  IS  "9372Fl“ 

1290  LIMIT  X1,X2,V1,Y2 
1300  OUTPUT  705; "VSS" 

1310  SCftLE  S,0,S,B 
1320  FOR  J=T2  TO  T 3 
1330  T  =  .J*Id 
1340  IF  T>N3  THEN  1370 
1350  PLOT  X>;T  ^ ,  Y-:.  j:.' 

1360  NEXT  J 
1370  PENUP 
1330  NEXT  In 
1390  END 
1400  ! 

1410  SUB  Exp'.:X,  Y,  fl,  £;■  !  EXP'CZV 

1460  ! 

1470  SUB  Lo.g'.:X,  Y,  fl,  E)  !  PRINCIPAL  LOG'.2> 

1550  ! 

1560  DEF  FNIfV^phi  '  !  INVPHI(X>  via  AMS  55,  26.2.23 

1570  IF  ■  ,X>0:.'  AND  'iX  1>  THEN  1600 
1580  P  =  9. 99999999999E90*';2*X-1  > 

1590  GOTO  1670 

1600  IF  X=.5  THEN  RETURN  0 

1610  P=X 

1620  IF  X>.5  THEN  P=.5-<X-.5> 

1630  P=^SO.R<.-Z*LOQ<  P  )  > 

1640  T»l+P»<;  1 . 4327S3-rP#'::  .  1  39269  +  P* .  00 1 308 >  ) 

1650  P=P-<2.515517t-P*<: .  802853+P*.  018328)  >^T 

1660  IF  X<.5  TtiEM  F=-P 
1670  RETURN  P 
1680  FNEND 
1690  ! 

1700  SUB  Ff  t  1  32';N,  x*;#  > ,  Y<*  >  > 

D-4 


!  N  <*  2-  13,  N=2''INTEGER,  0  SUBSCRIPT 
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APPENDIX  E.  ASYMPTOTIC  EXPANSIONS  FOR  DISTRIBUTIONS  WHEN  r>0 
The  characteristic  function  of  interest  is  given  by  (100)  and  (102): 

fh»)  -  (i^iy)"'’  (i-if™)""  (E-i) 

where  for  notational  convenience  in  this  appendix,  we  let 

V  =  n  *  Nr^.  «  =  1+2R  .  (E-2) 

The  cumulative  distribution  function  is  obtained  by  substitution  of  (E-l)  in 
(63): 


’■m  i  (l-n*.)"'’  -  iuf]  .  (E-3) 

The  v-th  powers  are  principal  value,  being  positive  real  where  C+  crosses 
the  positive  imaginary  axis. 


Now  let  z  =  1+if  in  (E-3),  yielding 


Ph(u) 


= J  dz  (z-l)“^  z"'^  (l+a>-uz)“'’  exp  -  u(z-l)J  .  (E-4) 


The  contours  and  Cj^  in  (E-3)  and  (E-4)  are  depicted  as  dashed  lines  in 
figure  E-l.  The  pole  at  ^=0  is  moved  to  Zal;  the  remaining  singularities  are 
branch  points  (v  non-integer);  the  v-th  powers  are  positive  real  where 
crosses  the  positive  real  axis.  For  u<0,  an  equivalent  contour  to  Cj  is 
that  indicated  by  C2  in  figure  E-l,  since  the  exponential  in  (E-4)  furnishes 
rapid  decay  in  the  left-half  z-plane.  We  write  (E-4)  in  the  form 

Ph(u)  - J  dz  z^''  exp(-uz)  gj(z)  ,  (E-5) 

^2 

where 


E-l 
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Figure  E-1.  Contours  of  Integration  for  Cumulative  Distribution  Function 

In  order  to  get  the  asymptotic  development  of  (E-5),  we  expand  gj^(z)  in 
a  power  series  in  z, 

=  gi{0)  +  gj(0)  z  +  ...  ,  {E- 


where 


9j(0)  =  (I*.)-''  exp(^).  ,  1  + 


Appeal  to  [10,  p.  96,  (4)]  then  yields  (for  all  v) 


Ph(u)  -  exp(u)||;f^  gj{0)  »  9^(0)]  . 

.  r(v)-'  exp[u  -  [l  .  ^ 


Substitution  of  (E-2)  in  (E-9)  then  yields  result  (104). 
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When  (E-1)  is  substituted  into  (64)  instead,  we  obtain  the  exceedance 
distribution  function  in  the  form 

1  =  157  J  ‘‘J  -  luf]  •  (E-10) 

c_  ^ 

1 

Now  let  z  =  ^  -  iji  to  get 

1  =  Tf7  i  -  7>  ^  (1  ^  7  -">■”  («)"’  * 

^3 

*  exppy^  +  u(z  -  i)l  .  (E-11) 

(1)  z  J 

The  contours  C_  and  C3  in  (E~10)  and  (E-11)  are  depicted  as  dashed  lines 
in  figure  E-2.  The  pole  at  y=0  is  moved  to  z  »  1/u;  the  remaining 
singularities  are  branch  points. 


Figure  E-2.  Contours  of  Integration  for  Exceedance  Distribution  Function 


For  u>0,  an  equivalent  contour  to  C3  is  that  indicated  by  C4  in 
figure  E-2,  since  the  exponential  in  (E-11)  furnishes  rapid  decay  in  the 
left-half  z-plane.  We  write  (E-11)  in  the  form 


E-3 


TR  7045 


l-P^(u)  =  0)  (l+u)”''  exp/-  r  dz  z"'’  expjuz  +  -f“l92(2)  .  (E-12) 


where 

93(2)  =  (l-«z)-^  (l  .  (E-13) 

As  above,  we  expand  93(2)  in  a  power  series  in  z, 

93(2)  =  1  +  (ii{l  +  z  +  ...  {E-14) 

and  substitute  it  in  (E-12);  employment  of  [10,  p.  105,  (2)]  now  yields  (for 
all  v) 


1  -  Ph(u)  ~  {!+«)"''  exp(-  * 


as  u -»  +••,  (E-15) 

where  ly(z)  is  the  modified  Bessel  function  of  the  first  kind.  This  is  the 
9eneral  result  for  the  exceedance  distribution  function;  the  various 
parameters  given  in  (E-2)  relate  it  back  to  the  problem  of  interest  in  the 
main  text. 

As  a  check  on  this  result,  we  let  r-^-O;  then  n-^0,  and  (E-15)  reduces, 
via  [6,  9.6.7],  to 

1  -  Ph(‘‘)  -  r(v)'^  »  exp(-U/»)[u^  yj;;)] 

as  U-*  +^;  r»0.  (E-16) 

Employing  the  identifications  in  (E-2),  there  follows  from  {E-16) 


E-4 
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N-2 

*[1.  u  -  -  ;  r.O  .  (E-17) 

In  order  to  compare  this  result  with  that  for  y“1»  sample  mean  removal,  we 
must  replace  N  here  by  N-1;  see  the  paragraph  under  (101).  When  this  is  done, 
(E-17)  reverts  precisely  to  (61)  and  (62). 

Returning  to  the  general  result  for  the  exceedance  distribution  function 
in  (E-15),  if  we  keep  n>0  and  use  [6,  9.7.1]  for  large  arguments  of  1^(2), 
there  follows  the  simpler  (less  accurate)  result 

1  -  P,(u)  -  j  ■  ^]  * 

*  u^  ^  J  asu-^-*-®*.  (E-18) 

When  (E-2)  is  substituted  in  (E-18),  the  result  quoted  in  (105)  follows. 

As  a  special  case  of  (E-18),  if  v=l  (i.e.  N=2),  then 

1  -  P.(u)  -  -Y12  ■  - 174  exp  T-  as  u-+«.  ;  v=l.  (E-19) 


E-5/E-6 
Reverse  Blank 
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APPENDIX  F.  EXCEEDANCE  DISTRIBUTION  FUNCTION  FOR  y=0,  N«1,  r>0 
CHARACTERISTIC  FUNCTION  APPROACH 

When  characteristic  function  (100)  with  N=1  is  substituted  in  (64),  the 
expression  for  the  exceedance  distribution  function  becomes 

1  -  Ph(u)  =  I  <1?  exp  -  iuf],  (F-1) 

where  u  =  1+2R  as  in  (102).  The  square  roots  are  taken  as  +1  at  |=0.  For 
u>p,  the  contour  C_  can  be  modified  to  that  indicated  in  figure  F-1,  where 
the  contributions  of  the  large  circular  arcs  in  the  lower-half  |-plane  tend  to 
zero.  The  small  circle  of  radius  p  centered  at  branch  point  -i/u  must  have 
0  <  p  <  l/oj,  since  the  latter  is  the  distance  to  the  pole  at  the  origin. 


Figure  F-1.  Equivalent  Contours  for  (F-1) 


It  is  easy  to  show  that  the  two  vertical  contributions  in  figure  F-1  are 
equal.  Under  the  change  of  variable 


(F-2) 


F-1 
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the  sum  of  the  two  vertical  contributions  to  exceedance  distribution  function 
(F-l)  becomes 


V{p) 


2(d 


1/2 


exp 


+<*> 

(-—)  1 


dt  (1+t^) 


-1 


*  (i+to+V) 


-1/2 


exp 


{F-3) 


This  integral  remains  convergent  even  as  pt>0+.  Furthermore,  the  integrand 
decays  rapidly,  has  no  cusps,  and  involves  only  elementary  functions;  also  the 
integral  is  a  sum  of  positive  quantities  and  retains  significance  even  for 
large  u. 


On  the  small  circular  contour  in  figure  F-l,  let 


if  «  _  _  p  exp(1©), 
0) 


(F-4) 


to  obtain,  for  the  circular  contribution  to  the  exceedance  distribution 
function,  the  quantity 


C(p) 


2ir(  1+0)) 


m 


exp 


\  do  {l-o)pE)"^  * 


— ir 


-1/2 

exp 


(*  f  *  K  »ue)  , 


(F-5) 


where  we  define  in  this  appendix 


X  =5 


0) 


(f5r)  *  ^  “  exp(i9)  . 


(F-6} 


F-2 
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The  exceedance  distribution  function  is  given  exactly  by  the  sum  of  (F-3) 
and  (F-5),  for  any  0  <  p  <  1/u.  It  would  be  advantageous  numerically  to  let 
p-*0+  in  these  two  equations;  however,  the  limit  of  (F-5)  is  not  obvious  and 
can  easily  be  done  incorrectly. 

AN  ERRONEOUS  APPROACH  FOR  C(p) 

It  is  tempting  to  let  p*0+  in  those  locations  in  {F-5)  where  it  will  "do 
no  damage",  obtaining  for  the  integral  with  scale  factor  p^^^  the  quantity 

IT 

Ip  *  p^^^  {  do  expj^i  I  +  ^  exp(-io)J  .  (F-7) 


(The  fallacy  of  doing  this  for  a  residue  cal  ulation  with  an  essential 
singularity  is  demonstrated  in  the  next  subsection.)  Furthermore,  the  limit 
of  {F-7)  as  p-*0+  can  in  fact  be  determined  in  closed  form,  as  follows. 

Observe  that  the  integrand  of  (F-7)  has  a  saddle  point  in  the  complex  e-plane 
at 


Og  =  -iL  ,  (F-8) 

this  is  in  fact  the  only  saddle  point  in  the  {-n,iT)  strip  in  the  e-plane.  Now 
let  z  =  e-e^,  getting  for  (F-7) 


I 

p 


(F-9) 


The  radius  p  now  appears  only  in  the  limit  L  of  the  integral,  and  the 
integrand  has  a  saddle  point  at  z»0. 


F-3 
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The  straight  line  contour  for  (F-9)  can  be  deformed  into  contour  C, 
depicted  in  figure  F--2,  which  goes  through  the  saddle  point  at  z=0.  Now  if 


p-*0+,  then  L-*-*--**,  and  (F-9)  yields 


I 


0 


ir+ico 


z 

7 


-TT+ioO 


(F-10) 


where  the  contour  is  the  limit  of  C  in  figure  F-2  as  that  is,  the 

integral  is  between  the  two  valleys  at  ^w+ioo  and  is  connected  by  the  saddle 
point  at  z=0. 

The  steepest  descent  curves  out  of  the  saddle  point  of  the  integrand  of 
(F-10)  are  given  explicitly  by 

y  »  -j(n(-5i^)  for  -ir  <  X  <  n  .  (F-ll) 


Thus  if  we  let 


F-4 
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z  =  x  +  iy  =  x-  i  in( )  , 

dz  1  ^  /COS  X  1» 

^  “  ~  ^in  X  “  x'  * 


(F-12) 


on  the  steepest  descent  curves  in  (F-IO),  there  follows 

IT 

^  ax(l  -  1  ^  1)  expf  ^  ^  1  ^  exp(-lxj) 

-IT 

IT 

=  ^ax(l  -  1  .  1  i)  exp[Hti]- 

-ir 

If 

=  (2x)^^^  2j'dx  exp^  |9-^  ■^)  -  (2x)^'2  2(2fr)^'^  =  4(xif)^'2  .  (F-13) 

0 

(The  integral  value  of  (2ir)^^^  in  (F-13)  was  deduced  by  numerical  integration.) 


Recalling  the  definition  of  in  (F-7),  we  then  have  the  dubious 
result  for  the  limit  of  (F-5): 


(F-14) 


where  we  employed  (102)  and  (F-6).  Actual  numerical  evaluation  of  (F-14), 
combined  with  V(0)  from  (F-3),  gives  incorrect  results  for  the  exceedance 
distribution  function  (F-1);  thus  the  replacement  of  p  with  0  in  (F-5)  is 
invalid.  The  explanation  for  this  pitfall  is  the  essential  singularity  of 
(F-1)  at  f  »  -i/w;  a  simpler  illustration  follows. 


F-5 
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RESIDUE  OF  ESSENTIAL  SINGULARITY 


The  function 


exp(i)  =  1  +  ^  +  y  +  ... 
^  21 


(F-15) 


has  an  essential  singularity  at  z»0,  with  residue  1,  as  exemplified  by  this 
Laurent  expansion.  Now  consider  the  function 


f(z)  =  exp(i)  g(z)  , 


(F-16) 


where  g{z)  is  analytic  at  z=0.  Then 


f{z)  =  (l  ^  7  *  ...^^g{0)  +  g^^^O)  z  +  ^^^^0)  z^  +  ...^  .  (F-17) 

The  coefficient  of  1/z  in  (F-17)  is  the  residue  of  f{z)  at  z*0;  namely 


Res  =  g(0)  +  g^^^O)  +^73-  g^^^O)  +  .. 


nl (n+] 


(F-18) 


Thus  the  residue  of  f(z)  at  z=0  depends  on  the  behavior  of  g{z)  in  a 
neighborhood  of  z=0,  and  not  just  the  value  g(0). 

A  couple  of  examples  yield  the  following: 


g{z)  »  (l-az)“^  ,  Res  = 


o  1,(23) 

g(z)  =  exp(a‘'z)  ,  Res  =  --  . 


(F-19) 


F-6 
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CORRECT  APPROACH  FOR  C(p) 

Reconsider  the  integral  in  {F-5)  plus  the  scale  factor  making  the 

substitution  z  »  o+iL,  where  L  is  given  in  {F-8),  there  follows  for  this  quantity 


ir+iL 


(2x)1'2  r 

-ir+iL 


dz  (l-2o)\  (1 


2(i)X 

1^0) 


1 


-J 


* 


*  exp[i  f  +  +  2xu  e^^]  .  (F-20) 

The  uppermost  singularity  of  the  integrand  in  the  z-plane  (within  the  -it,  it 
strip)  is  a  pole  at  Zp  =  i  Jh(2o)X);  however,  the  straight  line  contour  in 
(F-20)  remains  above  this  pole  because  p  <  l/u;  see  {F~8).  Furthermore,  the 
total  integrand  of  (F-20)  has  a  saddle  point  on  the  imaginary  axis  of  the 
z-plane  above  the  pole  location  Zp,  because  the  integrand  is  infinite  at  the 
pole  and  at  z  =  0  +(«*.  Thus  the  straight  line  contour  in  (F-20)  can  be 
modified  so  as  to  pass  through  the  saddle  point,  and  yet  remain  above  Zp, 
Finally,  letting  p-*0+,  then  L*'+**,  and  (F-20)  combined  with  (F-S)  yields  the 
exact  result  for  the  circular  component 


ir+i» 


where  the  two  valleys  of  the  integrand  at  *ir+i«p  are  joined  with  a  contour 
through  the  saddle  point  lying  above  the  pole  at  Zp  „  i  J^n(2ajx).  Here 
(0  -  1+2R. 


F-7 


TR  7045 


The  other  component  of  the  exceedance  distribution  function, 
corresponding  to  (F-21),  is  given  by  {F-3)  at  p  =  0+: 

Jdt  (1+t^)  ^  * 

0 

*(1+U)n^)  exp^  ^  t^  -  rLy  (F_22) 

Thus  for  u  5^  0,  (F-1)  and  figure  F-1  yield  exceedance  distribution  function 

1  -  P.  (u)  =  C(0)  +  V(0)  =  (F-21)  +  {F-22)  .  {F-23) 

n 

Computationally,  (F-21)  is  not  too  attractive,  because  of  the  complex 
integrand  and/or  the  need  to  determine  the  steepest  descent  paths  to  *ir+i«6 
numerically.  Accordingly,  an  alternative  direct  procedure  for  determining  the 
exceedance  distribution  function  of  random  variable  h  is  now  presented. 

DIRECT  EVALUATION  OF  EXCEEDANCE  DISTRIBUTION  FUNCTION 

For  Y=*0,  N=l,  (12)  and  (3)  yield  the  crosscorrelator  output  for  the 
signal  and  noise  model  as 

q  =  u^v^  =1  [uy  +  u^(l)  +  u^(l)]  [u^  +  v^(l)  +  Vjj{l)]  .  (F-24) 

The  normalized  crosscorrelator  output  is  then,  from  (49)  and  (97), 

h  = - ■ ,,  =  (r  +  u!  +  uM  (r  ♦  v'  *  vl)  j  xy  ,  (F-25) 

(0^0^)  '  u  s  d  V  s  d 

where  x  and  y  are  joint  Gaussian  random  variables  with  statistics 


F-8 


X  »  .  y  -  Ty  , 


=  1  +  R^.  Oy  -  1  +  Ry.  {x-x)(y-y)  -  . 

We  now  make  the  same  assumptions  as  in  (99);  see  also  (56)  et  seq. 
(F-26)  specializes  to 


X  =  y  =  r,  .  ,2  .  1  *  R,  „2_  ^  . 

The  joint  probability  density  function  of  x,  y  is  then  given  by 


r2.»Vl-p  ^  exp 

(x-r)^  +  (y-r)^  -  2o^y(x-r ) (y-r)! 

f  (1  pj(yj  J  exp 

2a^(l  -  p^^)  J 

We  now  have  cumulative  distribution  function 


Pj,(u)  =  dx  dy  P2(x,y)  for  u  <  0  , 


and  exceedance  distribution  function 


1  -  P|,(u)  =  j'j'  dx  dy  P2(x.y)  for  u  >  0  , 


R1-R3 
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(F-26) 

Then 

{F-27) 

(F-28) 

(F-29) 

(F-30) 


where  regions  Rj^,  R2,  R3,  R^  are  indicated  in  figure  F-3. 
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a 


Figure  F-3.  Regions  of  Integration 


If  we  now  rotate  axes  according  to 


(F-31) 


and  employ  (84)  and  {F-27),  there  follows  (after  scale  changes  of  the 
variables) 


P,(U) 


=  2  J  dv  -  r(2/u)^^^  f  ^(mv^-2u)^^^ 


for  u  <  0 


(F>32) 


and 


1 


p,(u)  .  2 


dv  ^(v) 


(F-33) 


Here  ui  =  1+2R,  These  real  integrals  are  very  useful  for  the  evaluation  of  the 
distributions  of  h  when  y«0,  N=1.  In  fact,  (F-33)  is  preferred  over 
{F-21)-(F-23);  but  (106)  is  preferred  over  (F-32)  since  $  need  not  be 
evaluated  in  (106).  This  is  in  fact  the  procedure  utilized  here  to  obtain 
numerical  results  for  this  case  of  y=0,  N=1. 


F-10 


TR  7045 


APPENDIX  G.  PROGRAM  FOR  EVALUATION  OF  OPERATING  CHARACTERISTICS  FOR  y»0 

The  conments  in  appendices  C  and  D  are  relevant  here  also.  The 
characteristic  function  used  as  the  starting  point  is  given  by  (100).  It  was 
observed  under  (103)  that  j^^(f)|  for  (100)  is  monoton i cal ly  decreasing  for 
all  Jr2i0»  the  choice  of  truncation  value  L  is  simplified;  see  appendix  D 
comments.  A  table  for  sampling  increment  (when  R=0)  follows. 


N  for  ral  for  ra2 


3 

.07 

.05 

4 

.07 

.05 

8 

.05 

.03 

16 

.04 

.02 

32 

.03 

.02 

64 

.025 

.015 

128 

.020 

.010 

256 

.012 

.007 

Table  G-l. 

Values  of  for  y=0 

10  ! 

GflMMP  =  0  HO  SAMPLE 

MERN  REMOVAL 

20 

Nc=32 

!  N,  Number  of  ter  me  add 

30 

Ps  =  l 

!  r.  Normalized  mean 

40 

De 1 1  a0  = . 03 

!  Initial  delta 

50 

Es  =  2*P  I'-'D'S- 1 1  a0*  .  375 

!  Bias  b  < depends  on  r> 

60 

Mf =2''10 

!  Size  of  FFT 

70 

OUTPUT  0;"GfiMMrt  =  0";" 

H  =";Nc;  ’•  r  =";Rs 

80 

OUTPUT  0;"" 

90 

DRTft  -4, -3, -2. 5, -2,-1. 5,-1 

,-.5,0, .5,1, 1.5,2 

100 

READ  Hs<*> 

!  SNR  R  =  2-^n 

110 

OUTPUT  0;ns<»); 

120 

DRTft  1,2, 2, 2, 2, 2, 2, 2, 2, 4, 4 

,4,8 

130 

READ  Ide-ltaC*) 

140 

MRT  De  1 1  ai=  <  De  1 1,  ^0  >  / 1  de  1 1  a 

150 

OUTPUT  0;Delta(*); 

160 

DRTR  lE-10, lE-9, lE-S, lE-7, 

lE-6,lE-5, lE-4, .001,  .01,  . 

170 

READ  Sc<:*) 

180 

DIM  H£<1:  12>,  Idelt.aC.0:  12), 

DeUa(0:  12),Sc<i:  14) 

190 

DIM  X  <  0 :  3 1 9 1 ) , Y  s  0 : 8 1 9 1 > 

200 

FOR  1=1  TO  14 

210 

Sc  (  I  )=FMlriMphi  CSc  <  I  >  ) 

220 

NEXT  I 

G-l 
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230 

S=Sc  (.  1  :■ 

240 

E  =  Sca4  • 

250 

Seal  e  =  ( B  -  S  >  ••  0  -  S  ) 

280 

XI  =30 

270 

X2=170 

280 

VI  =35 

290 

V  2  =  Y 1  +  <  X  2  -  X  1  >  *  S  c  a ! 

€ 

300 

PLOTTER  IS  "sersH" 

310 

LIMIT  X1,X2,Y1,'p2 

320 

OUTPUT  705; “VSS" 

330 

SCALE  S ,  0 ,  S- ,  E 

340 

FOR  1  =  1  rO  i-t 

350 

MOVE  S,S.:<i;) 

360 

DRAW  0,Sc<I> 

370 

NEXT  I 

380 

FOR  1=1  TO  11 

390 

MOVE  Sc  (l'>,  S 

400 

DRAW  Sc  a ) , B 

410 

NEXT  I 

420 

MOVE  S,S 

430 

BRAN  0,0 

440 

PENUP 

450 

Ml=Mf-l 

460 

N2=Nc-'2 

470 

R£n  =  Nc  »R£*R£ 

!  N  r^2 

480 

FOR  lr.  =  0  TO  12 

490 

IF  lrt>0  THEN  520 

500 

Rc=0 

510 

GOTO  530 

520 

Rc=2  '-N2.<:;  Iri  > 

!  SNR  R=2'n 

530 

OUTPUT  0;"R  =";r;':, 

(1 

Delta  =‘* ;  De  1  ia(  I  n) 

540 

ASSIGN  TO  "ABSC 

IS" 

!  Temporary  storage 

550 

De  1 1  a=De  1 1  a<  I n  :> 

!  for  false  alarm 

probabi H  ty 

560 

R  2 = R  c  *  2 

570 

R21=R2+1 

580 

Mux  =  Nc  *Rc  +R£ri 

!  Mean  of  random 

variable  h 

590 

MMy=M'.4;<  +  Bs 

!  Mean  of  shifted 

variable  y 

600 

REDIM  X<0;M1 >, YCO: 

Ml  ) 

610 

MAT  X=ZER 

620 

MAT  Y=ZER 

630 

X<0>=0 

640 

Y< 0>  = .  5 ^De  1 1  a*Mi.4y 

650 

Ls  =  0 

660 

Ls=L5+1 

670 

X  i  =D>»  1 1  a*Ls 

!  Argument  xi  of 

char.  fn. 

680 

Ei  =Xi  !fR21 

! 

Cal cul at  1  on 

690 

CALL  Log< 1+Xi ^Ei , - 

Xi  *R2 

, Ai , Bi >  ! 

of 

700 

CALL  Di  vCOiXi  *Rsri, 

1,-Ei 

,  C  i  ,  D  i  >  ! 

character! Stic 

710 

CALL  Exp':-Ci -N2*Ai  , 

D i +X 1 *Bs-N2»B i , Fyr , Fy 1 )  ! 

f unc  t i on 

720 

Ms=L£  MOD  Mf 

j 

fy<xi  ) 

730 

Ar=Fyr/Ls 

740 

Ai =Fy 4  xL£ 

750 

X (Ms ) =  X ( M  £  >  +  A  r 

760 

Yt:Ns>=Y(Ms>+Ai 

770 

Magsq=Ar*Ar +Ai  *Ai 

780 

790 

800 

G-2 


IF  l1agsq>lE-24 
OUTPUT  0;"Xi  = 


THEN 

= "  •  X  i 


660 


uu  I  r'u  I  *3 ,  1  =  ;  /i  1  ,  n 

CALL  Fftl.3z<rif,X<*),Y<»)) 


Mag  =" ; SQR<Mag£q) 


TR  7045 


810  FOR  Ms=0  TO  Ml 
820  T=Y<Ms>..'PI-Ms.,'Mf 

830  X<Ms>=.5-T  !  Cumulative  distribution  function 

840  YtMs>=.5+T  !  Exceedance  distribution  function 

850  HE>:T  Ms 

860  OUTPUT  0 ; Y  C 0 ) ; Y  f 1 > ; Y ( M 1 - 1  • ; Y ai  1 ) 

870  PLOTTER  IS  “ GRAPHICS" 

830  GRAPHICS 
890  SCALE  0,Mf,-J4,0 
900  LINE  TYPE  3 
910  GRID  Mf/8,1 
920  PENUP 
930  LINE  TYPE  1 
940  FOR  Ms=0  TO  Ml 
950  Pr  =  Y<Ms;' 

960  IF  Pr>=lE-12  THEN  Y=LGT<Pr) 

970  IF  Pr<=-1E-12  THEN  Y=-24-LGT<-Pr> 

980  IF  ABS<Pr> < lE-12  THEN  Y=-12 

990  PLOT  Ms , Y 

1000  NEXT  Ms 

1010  PENUP 

1020  FOR  Ms=0  TO  Ml 

1030  Pr=X<Ms) 

1040  IF  Pr>= IE- 12  THEN  Y=LGT<Pr> 

1050  IF  Pr<=-1E-12  THEN  Y=-24-LGT<-Pr ) 

1060  IF  AES<:  PrW  ie-12  THEN  Y  =  -12 

1070  PLOT  Ms,Y 

1080  NEXT  Ms 

1090  PENUP 

1100  DUMP  GRAPHICS 

1 110  OUTPUT  0; " " 

1120  IF  ln)0  THEN  1270 

1130  FOR  Ms=0  TO  Ml 

1140  IF  Y<Ms><..7  THEN  1160 

1150  NEXT  Ms 

1160  M2=Ms-l 

1170  FOR  Ms=M2  TO  Ml 

1180  IF  Y<Ms><=0  THEN  1200 

1190  NEXT  Ms 

1200  M3=M5-1 

1210  REDIM  X'::M2:M3) 

1220  FOR  Ms=ri2  TO  M3 
1230  X <Ms > =FN I nuph i <YCNs>  > 

1240  NEXT  Ms 

1250  PRINT  #l;X<*)  !  Store  false  alarm  probability 

1260  GOTO  1460 

1270  REDIM  X<;M2:M3> 

1280  READ  #l;X<*>  !  Read  in  false  alarm  probability 

1290  Id=IdeUaan> 

1300  J2=INT<M2/Id) 

1310  J3=INT<M3/Id>+1 

1320  FOR  J»J2  TO  J3 
1330  Y  <  J ) =FN I n vph i <  Y  <  J  >  > 

1340  NEXT  J 


G-3 
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1350 

PLOTTER  IS  '‘9872R" 

1360 

LIMIT  X1,X2,Y1,Y2 

1370 

OUTPUT  705;'‘VS3'‘ 

1380 

SCALE  S,0,S,B 

1390 

FOR  J=J2  TO  J3 

1400 

T=J*Id 

1410 

IF  T<ri2  THEN  1440 

1420 

IF  T>M3  THEN  1450 

1430 

PLOT  X<T>,YCJ> 

1440 

NEXT  J 

1450 

PENUP 

1460 

NEXT  In 

1470 

END 

1480 

! 

1490 

SUB  D i y ( X 1 , Y 1 , X2 , Y2 , A , B ) 

!  D I V  <  Z  ) 

1540 

( 

1550 

SUB  E  X  p ( X , Y , A , B ) 

!  EXP <2) 

1600 

1 

1610 

SUB  LogCX, Y, A, B> 

!  PRINCIPAL 

L0G<Z> 

1690 

! 

1700 

DEF  FNInyphi  OO 

'  1NVPHI<X>  uia  AMS 

55,  26.2.23 

1830 

1 

1840 

-•.:£!  Ff  t  1  33  (  N  ,  X  ,  Y  <*')'> 

!  N  <=  S-'IS,  N  =  2^INTEGER,  0  SUBSCRIPT 

G-4 


TR  7045 
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Under-Ice  Roughness: 
Shot  Noise  Model 


A.  H.  NuttaU 

ABSTRACT 

The  one-dimensional  roughness  of  an  under-ice  profile  of  elliptical 
bosses  is  modeled  in  the  time  domain  by  a  shot-noise  process  of  ellip¬ 
tical  pulses  of  random  amplitude,  duration,  and  time  of  occurrence,  A 
sample  realization  of  8000  data  points  is  generated  and  plotted  for 
visual  comparison  with  experimental  under-ice  data.  Also,  theoretical 
and  simulation  results  for  the  power  density  spectrum,  the  auto¬ 
correlation  function,  the  characteristic  function,  the  cumulative 
distribution  function,  and  the  probability  density  function  of  the  shot- 
noise  process  are  plotted  and  compared. 


Approved  for  public  release;  distribution  unlimited. 


INTRODUCTION 
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The  under-ice  profile  has  been  observed  to  appear  like  a  random 
collection  of  superposed  elliptical  bosses,  each  of  random  amplitude,  length, 
and  location.  An  analogous  model  in  the  time  domain  is  shot  noise  composed  of 
overlapping  pulses  of  random  amplitude,  duration,  and  time  of  occurrence. 
Accordingly,  we  have  generated  a  sample  realization  of  a  shot  noise  process 
for  visual  comparison  with  experimental  under-ice  data,  and  tor  possible 
corroboration  of  this  model.  The  particular  realization  generated  has  8000 
data  points,  although  the  number  of  effectively-independent  samples  is  far 
fewer,  as  will  be  demonstrated. 


A  number  of  analytical  results  for  shot  noise  have  been  derived  in  the 
past  [1];  however,  they  did  not  cover  the  case  of  random  duration  modulation. 
We  have  extended  the  analyses  to  include  random  durations  (as  well  as  random 
amplitudes  and  random  time  occurrences)  and  evaluated  the  spectrum  of  the  shot 
noise  process,  as  well  as  the  autocorrelation  function  and  the  first-order 
characteristic  function  of  the  instantaneous  amplituue.  From  the  latter,  the 
first-order  probability  density  function  and  cumulative  distribution  function 
of  shot  noise  have  been  evaluated  via  a  generalized  Laguerre  expansion 
employing  32  cumulants  or  moments.  Comparisons  of  all  these  theoretical 
results  with  the  corresponding  sample  quantities,  obtained  from  the  8000  data 
point  realization  above,  reveal  excellent  agreement. 
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A  REALIZATION  OF  A  SHOT-NOISE  PROCESS 

Shot  noise  is  characterized  by  a  superposition  of  pulses,  each  located 
independently  and  uniformly  on  the  time  scale.  A  sample  pulse  is  illustrated 
in  figure  1.  The  time  of  occurrence  tj^  (center  of  symmetrical  pulse,  for 


example)  is  uniformly  distributed  in  time  t,  with  an  average  number  of  pulses 
per  second,  v.  The  amplitude  aj^  and  half-duration 
pulse  are  also  all  independent  and  are  each  identically  randomly-distributed 
with  arbitrary  probability  density  functions.  Finally  the  fundamental  pulse 
shape  F  in  figure  1  is  arbitrary. 


of  an  individual 


A  realization  of  shot  noise  is  given  by 


I(t) 


(1) 


where  the  summation  extends  over  all  k.  The  particular  data  we  generate  here 
employs  the  following  example;  unsealed  pulse  shape  F  is  circular: 


F(x) 


-x^for  jxj  <  1 
0  for  jx|  >1 


(2) 
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This  pulse  is  continuous;  however,  it  has  cusps  (infinite  slope)  at  x  =  *1. 
The  reason  for  this  selection  will  become  apparent  when  we  discuss  the 
spectrum  of  shot  noise  process  (1). 


The  amplitude  probability  density  function  for  random  variable  aj^  is 
Rayleigh, 

i 

.2 


p(a}  =  exp  )U(a) 
‘^a  \2‘^a. 


(3) 


and  the  duration  probability  density  function  for  random  variable is  also 
Rayleigh, 


P(X)  =*  I • 

^31  V^J 


(4) 


Here,  step  function 


U(x)  = 


1  for  X  >  0 
0  for  X  <  0 


(5) 


The  mean  values  of  random  variables  a^  and  are  given  respectively  by 

■  (?K’ 

in  terms  of  the  parameters  and  ^  of  probability  density  functions 
(3)  and  (4).  Alternatively,  the  mean  square  values  are  given  by 


?  =  a^  »  2og  ,  =  2^^  .  (7) 

Three  typical  component  pulses  are  depicted  in  figure  2,  and  can  range 
from  circular  through  various  elongated  elliptical  shapes.  The  total  length 
of  an  individual  pulse  is  L|^  »  2J^.  An  important  parameter  of  this  time- 
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^3 


limited  pulse  shape  in  figures  1  and  2  is  the  (dimensionless)  overlap  factor 


tjjV  =  21;,.  .  2 


(8) 


This  is  the  average  number  of  pulses  that  are  overlapping  at  any  one  instant 
of  time,  and  is  a  partial  measure  of  the  applicability  of  the  central  limit 
theorem.  A  more  meaningful  measure  are  the  cumulants,  for  probability  density 
function  (3)  and  pulse  shape  (2),  the  normalized  third  and  fourth  cumulants  are 


1.017 


and 


1.2 

4“ 


9 


(9) 


respectively.  In  the  sample  realization  generated  here,  the  overlap  factor  in 
(8)  was  6.2,  leading  to  normalized  cumulant  values  in  (9)  of  .58  and  .39, 
respectively.  Since  a  Gaussian  probability  density  function  would  lead  to 
zero  cumulants  above  second-order,  the  shot  noise  realization  dealt  with  here 
is  distinctly  non-6aussian. 
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In  the  three  parts  of  figure  3,  a  realization  of  shot  noise  model  (1)  is 
given  for  parameter  values 

cr^  =  1  sec,  (j  =  20  sec,  v  =  .124  pulses/sec.  (10) 

The  waveform  (1)  is  sampled  at  unit  time  increments  and  connected  by  strai^t 
lines;  thus  the  initial  100  data  points  illustrated  in  figure  3A  have  a  jagged 
appearance  for  those  component  pulses  with  small  as  for  example  at  time 
instants  67-68.  The  larger  duration  pulses,  like  the  one  centered  at  t  «  29, 
have  a  smoother  appearance. 

In  figure  3B,  the  initial  1000  data  points  illustrate  the  very  erratic 
character  of  shot  noise;  the  waveform  consists  of  some  very  sharp  spiky  pulses 
and  other  broader  smooth  components.  The  appearance  of  a  downward  trend  in 
these  1000  data  points  is  erased  when  the  entire  8000  data  point  sequence  is 
viewed  in  figure  3C.  The  possibility  of  shot  noise  process  (1)  reaching  a 
zero  value  (when  no  pulses  overlap)  is  confirmed  by  the  waveform  values  near 
t  «  6400. 
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CORRELATION  AND  SPECTRUM  OF  SHOT  NOISE  PROCESS 


The  derivations  of  the  correlation  and  spectrum  of  the  shot  noise  process 
(1)  are  given  in  appendix  A;  from  (A-12),  we  have,  in  general,  the  correlation 
function  at  delay  T, 


RjCD  -  V  ?  Jd^  pCe)je  i>(T/Ji)  *  Idc  » 


where  the  dc  component  of  I(t)  is,  from  (A-13), 


W  “  v  a  J  dx  F(x)  , 


<t>(y)  =  J 


dx  F{x)  F{x-y) 


is  the  (aperiodic)  correlation  of  an  individual  pulse  F.  (All  integrals  are 
over  the  range  of  non-zero  integrand. ) 


Also,  from  (A-16),  the  general  spectrum  of  process  I(t)  is,  at  frequency 


G,(f)  •  V  7  J  <«  pC{)  +  4  .  (W) 


where 


S(f)  =  Jdx  exp(-i2iifx)  F(x) 


is  the  voltage  density  spectrum  (Fourier  transform)  of  pulse  F.  Thus 


|S(f)p  i 


is  the  energy  density  spectrum  corresponding  to  pulse  F. 
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It  should  be  observed  that  the  entire  probability  density  function  p(JJ) 

of  half-duration  random  variable  is  required  in  order  to  evaluate  the 

correlation  or  spectrum  of  shot  noise.  However,  only  the  first  two  moments,  'a 
”7 

and  a  ,  are  required  known  about  probability  density  function  p(a)  of 
amplitude  random  variable  aj^.  The  only  way  that  the  dc  term  can  be 

zero  is  if  random  variable  aj^  has  zero  mean  (a  =  0),  or  if  pulse  F  has  zero 
area  {$(0)  =  0). 


Example 


The  example  of  interest  here  was  given  earlier  in  (2)  and  (4),  namely  a 
circular  pulse  F  and  a  Rayleigh  probability  density  function  for  random 
variable  i|^.  The  spectrum  Gj(f)  in  (14)  is  evaluated  in  (A-17)  through 
{A-22),  with  the  results 


0i(2irf) 

S(f)  •=?» 

'dc  “  /'?)  ”  ^  5  • 


P  -T  P  2  exp(-z)  I,(z)  ,  v3  p  _2  p  , 

Gj(f)  =  2ir^  V  a^  - - - i - +  ^  a  j(f ) 

with  z  =  (2ir^  f  )^.  (16) 

The  asymptotic  behavior  of  spectrum  (16)  is  [2,  eq.  9.7.1] 

T-  - 

Gi(f)- as  (17) 

(2ir)  1 
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That  is,  the  spectrum  decays  at  a  -30  dB/decade  rate  at  large  frequencies; 
this  is  due  to  the  square  root  singularities  at  x  =  *1  of  pulse  F  given  in 
(2).  This  decay  rate  has  been  observed  in  some  spectral  analyses  of  under -ice 
profiles,  and  was  one  of  the  reasons  for  choosing  the  specific  circular  pulse 
in  (2)  for  this  investigation. 

The  spectrum  in  (16)  is  plotted  in  figure  4,  for  the  choice  of  parameters 
earlier  in  (10),  as  a  dashed  line,  normalized  to  0  dB  at  f  =  0.  Superposed  is 
a  linear -predictive  spectral  analysis  result  with  predictive  order  10,  for  the 
8000  data  points  of  figure  3C.  The  two  results  are  in  excellent  agreement, 
even  at  the  -50  dB  level,  with  the  inevitable  3  dB  aliasing  effect  at  the 
Nyquist  frequency,  as  indicated. 

The  correlation  Rj(T)  in  (11)  is  evaluated  in  (A-23)  through  (A-33), 
for  the  example  (2)  and  (4),  with  the  result 

RjCC)  =  |(2,f)^*  V  ?  s  exp(-s)  [(1+4S)  K^(s)  -  (3+4s)  + 

*  v'  r  With  s .  .  (18) 

This  quantity,  exclusive  of  the  term,  and  normalized  at  the  origin,  is 
plotted  in  figure  5  as  a  dashed  line,  for  delays  (lags)T  up  to  100.  It  is 
seen  to  decay  monoton i cal ly  to  zero  as  T  increases,  and  reach  its  1/e  value  at 
approximately  1:=  30. 
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The  remaining  solid  curve  on  figure  5  is  the  normalized  sample 
autocorrelation  function  of  the  8000  data  point  sequence  in  figure  3C,  where 
the  sample  mean  was  subtracted  from  the  given  data.  The  agreement  with 
theoretical  result  (18)  is  excellent.  The  dotted  horizontal  lines  at  *2a  in 
figure  5  are  the  *2  sigma  values  of  the  correlation  estimate  at  delays  where 
the  true  correlation  is  presumed  zero;  the  details  of  this  analysis  are  given 
in  appendix  B. 

This  procedure  is  duplicated  in  figure  6,  where  the  correlation  function 
estimate  out  to  lag  17=  1000  is  plotted.  The  drifting  of  the  estimate  outside 
the  *2a  limits  (at  Ta  470  and  820)  is  consistent  with  an  occasional  excursion 
of  a  random  variable  outside  its  *2a  range.  The  correlation  estimate  (used 
for  figures  5  and  6)  at  time  separation  k  is 
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/WPLITUOE  STATISTICS  OF  SHOT  NOISE 


The  first-order  characteristic  function  of  shot  noise  process  I(t)  is 
derived  in  appendix  C;  it  is  given  by  (C-9)  as 

fj(f)  .  exp  [v  jrfdx{f^SF(x)]-l}]  •  (20) 

Here  f^  is  the  first-order  characteristic  function  of  amplitude  random 

Q 

variable  aj^.  Observe  that  the  probability  density  function  p(^)  of 
duration  is  irrelevant  to  characteristic  function  f j,  except  for  its 
mean  this  is  in  contrast  to  the  spectrum  and  correlation  results  in  (11) 
and  (14),  where  p(a)  was  irrelevant  except  for  parameters  a  and  a  .  (For 
=  1  for  all  k,  (20)  reduces  to  a  simplified  version  of  [1,  eq.  a. 5-4].) 


The  characteristic  function  of  the  amplitude  random  variable  a|^  can  be 
expanded  in  terms  of  its  moments 


according  to 


n^(n)  =  a"^  “  n  0  , 

fa(F)  «  !^Wa(n)(if)"/nl  . 

n^o 


(21) 


(22) 


This  result  is  useful  if  the  J^n  of  (20)  is  expanded  in  a  series  inj;  namely 


^n  f  (J)  .  V  wjn)(i|) 
n=:l 

giving  immediately  the  cumulants  of  I(t)  as 


dx  F''’(x)/nl  , 


(23) 


^(n)  =  V  ^  Wg(n)  J  dx  f‘’(x)  for  n  ^  1  . 


(24) 
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That  is,  the  n-th  cumulant  of  I{t)  is  proportional  to  the  n-th  moment  of 
random  variable  aj^  as  well  as  the  n-th  "moment"  of  pulse  F.  (For 
for  all  k,  (24)  reduces  to  [1,  eq.  1.5-2].) 


The  normalized  cumulant  of  I(t)  is 


1  U,('')  p"(*) 


■  i  -a'  '  u 

^  T  F 

Ct,(2)]  (yX)  luj(2)  J  dx  f2(x) 


.  (25) 


In  particular,  the  coefficients  of  skewness  and  excess  [3,  pp.  184  and  187] 
are 

I  y^O)  I  dx  f3(x) 


'^(3) 


Ua(2)  J dx  f2(x) 


f 


(26) 


and 


(4)  = 


I  ^^(4)  J  dx  F^(x) 
vX  1^3(2)  J  dx  F^(x^ 


(27) 


These  quantities  are  very  important  measures  of  the  approach  of  I(t)  to  a 
Gaussian  process;  if  vX  is  very  large,  the  normalized  cumulants  Yj(n)  are 
all  substantially  zero  for  n  ^  3,  meaning  that  I(t)  is  nearly  Gaussian.  Thus 
although  probability  density  function  p(X)  is  not  directly  relevant  to  the 
probability  density  function  or  characteristic  function  (20)  of  I(t),  the 
exact  probability  density  function  of  I(t)  is  critically  dependent  on  the 
mean  X  through  the  dimensionless  parameter  vA.  More  precisely,  (26)  and  (27) 
are  the  critical  quantities;  see  also  [1,  eq.  1.6-3]. 
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If  either  the  third  moment  of  random  variable  aj^  is  zero,  or  if  the 
third  moment  of  pulse  F  is  zero,  then  yj(3)  =  0.  In  that  case,  yj(4)  is 
the  most  important  statistic  measuring  the  applicability  of  the  central  limit 
theorem;  yj(4)  can  never  be  zero  for  shot  noise,  since  neither  the  fourth 
moment  of  random  variable  aj^  or  pulse  F  can  be  zero  (except  in  a  trivial 
case ) . 


The  first  moment  of  shot  noise  I{t)  is  the  mean 

'dc  =  V  fdx  F(x)  (28) 

and  has  already  been  encountered  in  (12).  It  can  be  zero  only  if  the  first 
moment  of  random  variable  or  of  pulse  F  is  zero. 

Example 


Numerous  cases  have  been  considered  in  appendix  C;  in  the  main  body  here, 
we  limit  attention  to  example  (2)  and  (3)  presented  earlier.  We  find 


II 

^(n)  =  l)  a"  for  n  >  0  , 


jdx  f"( 


X)  = 


.nn  p2  l^n  ,  ^ 


nn+2) 

Then  (26)  and  (27)  yield  result  (9)  quoted  earlier. 


for  n  >  0  . 


(29) 


The  realization  of  shot  noise  process  I(t)  in  figure  3C  employed  the 
parameters  in  (10).  The  sample  cumulative  distribution  function  of  these  8000 
data  points  is  depicted  in  figure  7,  on  a  normal  probability  ordinate;  thus  a 
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truly  Gaussian  random  variable  would  have  the  straight  line  character 
indicated.  The  significant  deviation  of  the  sample  cumulative  distribution 
function  from  the  Gaussian  line  is  due  to  the  small  value  of  the  overlap 
factor  in  (8),  namely 

V  =  2  V  «  6.2  .  (30) 

The  moments  in  (29)  are  all  positive  and  are  easily  numerically  evaluated 
via  recursion;  hence  the  cumulants  in  (24)  can  be  accurately  evaluated  for 
high-order  n.  When  these  cumulants  are  employed  in  a  generalized  Laguerre 
expansion  of  the  cumulative  distribution  function  of  I(t),  using  32  moments  of 
(29),  the  solid  curve  in  figure  8  is  obtained.  The  sample  cumulative 
distribution  function  of  figure  7  is  duplicated  here,  although  the  abscissa  is 
scaled  differently.  The  agreement  between  theory  and  experiment  in  figure  8 
is  excellent,  considering  the  fact  that  we  only  have  about  8000/30  =  270 
effectively  independent  samples  of  I(t)  in  figure  3C;  the  denominator  factor 
of  30  here  is  the  effective  correlation  duration,  previously  identified  in 
figure  5  at  the  1/e  point. 

Finally,  when  the  same  32  moments  are  used  in  a  generalized  Laguerre 
expansion  of  the  probability  density  function  of  I(t),  the  result  in  figure  9 
is  obtained.  The  small  bump  near  the  origin  is  real  and  accurate;  it  and  the 
non-symmetric  tails  of  the  probability  density  function  confirm  the  distinctly 
non-Oaussian  character  of  I(t).  The  method  for  the  determination  of  the 
cumulative  distribution  function  and  probability  density  function  in  figures  8 
and  9  will  be  presented  in  a  NUSC  Technical  Report  [4]  by  the  author;  the 
programs  are  listed  here  in  appendix  0,  along  with  an  example  of  the  sequence 
of  Laguerre  coefficients. 
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APPENDIX  A.  DERIVATION  OF  SPECTRUM  AND  CORRELATION 


The  method  employed  below  follows  that  given  by  Rice  [1,  sections  1.4  and 
1.5]  rather  closely.  We  generalize  [1,  eq.  1.3-1]  to  the  current  form 
introduced  in  (1): 


(A-1) 


where  {a,;} ,  are  all  independent  random  variables.  K  is  the 

presumed  number  of  pulses  to  occur  in  a  large  time  interval  T,  and  is  a 
random  amplitude  as  in  [1,  eq.  1.5-1];  but  random  duration  ^1^  is  new.  Then 
product 


(A-2) 


k^m  ' 

Holding  random  variables  {a^^  and  fixed  for  now,  the  statistical 
average  of  (A-2)  over  is 


+ 


K  K  K 

-  i 4 ^  \  \ 4  4  ■  (*-3) 

kal  k«l  m*l 

kfm 
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where  T  is  an  arbitrary  large  {but  finite)  time  interval,  and 

f  (y)  »  Jdx  F(x)  F(x-y)  (A-4) 

is  the  aperiodic  autocorrelation  of  pulse  F,  while 

S(f)  =  J'dx  exp(-i2irfx)  F(x)  (A-5) 

is  the  voltage  density  spectrum  of  F. 

The  remaining  averages  over  independent  random  variables  and 
now  yield 


t  K  7  [dje  pU)^  ^>(T:/J()  +  ^  (K^-K)  [? Jl  S(0)]^  (A-6) 

Where  p(j^)  is  the  probability  density  function  of  random  variable 

Now  K  is  itself  a  random  variable,  with  discrete  probability 
(in  an  interval  T)  of  [1,  eq.  1.1-3] 

exp(-vT)  for  K  =  0,  1,  2,  ...  .  (A-7) 

There  then  follows  the  characteristic  function  of  random  variable  K  as 

f,^(|’)  =  exp^vT[exp(if)  -  1]),  (A-8} 

with  series  expansion 

oe> 

Av  =  vT  [exp(ir)-l]  =  vT  ^  .  (A-9) 

n=l 

Thus  the  cumulant^  of  random  variable  K  are  all  equal, 

X|^(n)  =  vT  for  n  2  1  »  (A-10) 

giving  in  particular  the  first  two  moments 

K  =  vT,  I?  =  vT(vT  +  1)  . 
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The  use  of  (A-11),  to  perform  the  remaining  average  of  (A-6)  with  respect 
to  random  variable  K,  then  yields  the  correlation  function  of  the  shot  noise 
process  I{t): 

Rj{t:)  «  V  pU)^  UzW  *  [v  a  J  S(0)]^.  (A-12) 

The  dc  component  of  I(t)  is 

Idc  “  ®  X  ®  •  (A-13) 

The  spectrum  of  I(t)  is  the  Fourier  transform  of  (A-12); 

3j(f)  .  V  ?  f  dJl  S(f)  .  (A-14) 

where 

5(f )  »  j*  dr  exp(-i2irfT)  ^(T)  » 

»  jdt  exp(-i2irfT)  j  dx  F(x)  F(x-t)  =  )s(f)j^.  (A-15) 

by  use  of  (A-4)  and  (A-5).  Thus  (A-14)  can  be  expressed  as 
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Then  from  (A-5)  and  [5,  eq.  3.752  2], 


S(f)  =  dx  exp{-i2irfx)  (l-x^« 


Substitution  of  (A-17)  and  (A-18)  in  the  inteqral  in  (A-16)  yields 
[5,  eq.  6.633  2], 

where 


z  =  {ZKCj^fr 

Then  the  spectrum  (A-16)  is  given  by 


2  "T  2  2  exp(-z)  I,(z)  2 

Gj(f )  »  2ir  V  a  - g(f)  , 


where 


^dc  “  ®  “  (ly  ^  % 

by  means  of  (A-13),  (A-18),  and  (6). 

To  determine  the  correlation  of  shot  noise  process  I(t), 
first  the  continuous  portion  of  the  spectrum  in  (A-21): 


s,(f) 


2  2  ^  exp(-4ir^ij^f^)  Ij(4ir^^V) 

2it  V  a  o,  - A-'^"  X - 


(A-18) 

,  by  use  of 

.  (A-19) 

(A-20) 

(A-21) 

(A-22) 

we  consider 

(A-23) 
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The  corresponding  correlation  is 


=  i*  exp{i2»fr}  G^.{f) 
-5© 


Jfi  A  2  2f2^  r  /.  2  2f2s 

O  T  9  f  exp(-4ir  a  T  )  I,  (4Tr  a,  f  ) 

=  4t  V  0*  df  2  C0S(2irfT)  - y  A-k - ^ -  » 

^  L  4irS/f^ 


2  2^2, 


=  2ir  V  a 


f  /-r  A  exp{-z)  I,{2) 

5rn^^)-v— 


^  0 

=  2  ir  V  a^  a  exp(-s)  W  ^  _^(2s) 

^  ~T*  * 


where  we  employed  (A-20)  and  [5i  eq.  6.755  2],  and  defined 

•  ■  (f)  ■ 

The  W-function  in  (A-24)  is  the  Whittaker  function  [2,  p.  505] 
Now  by  [5,  eqs.  9.232  1  and  9.222  1],  we  have 


W  3  ^(2s)  =  W  3  j(2s) 

"2’  2  ~V''2 


exp 


ith  r 


U  _ 

dt  exp(-2st)  t'*  (1+t) 


«^exp(-s)  rdtexp(-2st)^^-l-^--^^^ - ^ 

^  ^  [t  (l+t)  t  (1+t) 

But  according  to  [5,  eq.  3.364' 3], 

dt  =  exp(as)  KQ(as)  . 

•^3  /"(a+t)^ 


(A-24) 


(A-25) 


(A-26) 


(A-27) 
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Partial  differentlon  with  respect  to  a  then  yields 
oo 

-  ^  y  dt  -  s  exp(as)  [RgCas)  -  Kj{as; 

0  t  (a+t) 


(A-28) 


and  (repeated) 


3  dt  e^P(-2st) 

4  j  ‘/r  > 

0  t  (a+t) 


2  r  Ktlas)! 

s^  exp(as)  2KQ(as)  -  2K^(as)  +  — I. 


{A-29) 


Here  we  used  [2,  eq.  9.6.28]  in  the  forms 


KMz)  «  -  K,{2),  KMz)  =  -  Mz)  - 


K,(z) 


(A-30) 


If  we  now  set  a  »  1  in  (A-28)  and  (A-29),  and  then  employ  these  results 


in  (A-26),  we  obtain 


W  3  i(2s)  =  -4-f®  [(1^4s)Kj(s)  -  (3+4s)Kq(s)].  (A-31) 


I*  7 


Finally,  the  use  of  (A-31)  in  (A-24)  yields 


R^(r)  =  |(2ir)'*  s  exp(-s)[(l+4s)K^(s)  -  (3+4s)Kq(s)'].  (A-32) 


The  Fourier  transform  of  the  impulsive  part  of  the  spectrum  in  (A-21)  is  simply 
the  constant 


4  • 


(A-33) 


which  must  be  added  to  Rc(T)  in  (A-32)  to  obtain  Rjd")*  Here  s  is  given  by 
(A-25). 


As  ’^■♦0+,  there  follows  from  (A-32), 

lim  R_(T)  =  |•(2w)^*v  ?  tt 
T-»CH-  c  J  2 


(A-34) 
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APPENDIX  B.  VARIANCE  OF  CORRELATION  ESTIMATE 


Let  the  available  data  be  with  zero  mean  and  variance  o: 


forl<n<N. 


(B-1) 


The  autocorrelation  estimate  at  delay  k  is  defined  here  as 


(B-2) 


At  delay  0,  the  mean  value  of  estimate  R^  is 


r-  1  ^  ^2  _  2 

0  n 


(B-3) 


We  now  want  to  evaluate  the  standard  deviation  of  estimate  Rj^  at  delays 
k  large  enough  that  and  x^_j^  are  statistically  independent.  We  have 


mean  value 


\  ^n  ^n-k  ~  ^  » 

^  N  n=k+l  "  " 


(B-4) 


using  the  independence  at  separation  k.  The  mean  square  value  of  estimate 
Rk 


~7  1  ^ 

Rk  «4  ^ 

^  fT  m,n=l 


ffi  n  fn*4c  n  “4c 


(B-B) 


For  the  large  separation  values  k  of  interest  here,  the  only  statistical 
dependence  that  contributes  non-trivially  to  the  double  sum  is  the  following: 
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N 


m,nsk+l 


.  X  , 

m  n  m-k  n-k 


4^2 

S'  0  (m-n)  » 

m,nak+l 


-4  (N-k-|n;)  p^{n)?  4  (N-k)^  »^(n)  .  (B-6) 

N  |nt^ 

Here  p  is  the  correlation  coefficient  of  data  and  we  have  assumed  that 

N  is  moderately  larger  than  the  effective  correlation  length  of  p.  The  ratio 
of  the  standard  deviation  of  estimate  Rj^  to  the  mean  value  at  k=0  is  then 
the  normalized  standard  deviation  at  separation  k: 


(B-7) 


Notice  that  no  Gaussian  assumptions  on  data  have  been  employed  in  this 
analysis;  however*  p{k)  is  essentially  zero  at  the  k  values  of  interest. 


As  an  example,  for  an  exponential  correlation  of  effective  length  Kg, 
there  follows 

^  exp  (-2j^')=  dx  exp  (^2^^  =  K  ,  (B-8) 

n  n  \  e>'J  \'^ey 

where  we  assume  that  Kg  is  moderately  larger  than  unity.  Then  (8-7)  yields 

^(NT<)Kg]^  (B-9) 

These  results  hold  only  for  those  values  of  k  where  p(k)  has  substantially 
gone  to  zero.  Larger  values  of  Kg  lead  to  larger  relative  standard 
deviations;  this  is  consistent  with  the  fact  that  there  are  then  a  lesser 
number  of  effectively-independent  samples  in  the  limited  data  set  of  length  N. 
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For  the  8000  data  pcint  example  of  interest  here,  inspection  of  figure  5 
reveals  that  Kg=  30.  Thus 

*2..  .  .  .  (8.10, 

These  confidence  limits  are  superposed  as  dotted  lines  on  figures  5  and  6. 
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APPENDIX  C.  PROPERTIES  OF  CHARACTERISTIC  FUNCTION  OF  SHOT  NOISE 

Derivation  of  Characteristic  Function 

The  method  of  derivation  of  the  characteristic  function  of  I{t)  presented 
here  parallels  that  of  Rice  [1,  sections  1.4  and  1.5]  very  closely.  We 
generalize  [1,  eq.  1.3-1]  to 


where  are  all  independent  random  variables;  see  (A-l) 

and  the  ensuing  discussion.  The  characteristic  function  of  an  individual 
component  in  (C-1)  is 

fl(f)  =  exp  if  e|( 


where  the  statistical  average  is  over  \  »  .  The  average  over 

t|^  (for  fixed  aj^,  is,  for  T  a  large  but  finite  time  interval 

[1,  P.  152], 
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for  large  T,  where  we  have  used  the  fact  that 

F(x)-»  0  as  x-»  *e®.  (C-4) 

Let  X  =  (C-3)  to  get 

Mk  +  1  •  (C-5) 

Now  performing  the  averages  on  random  variables  and  aj^,  we  have,  for  the 
characteristic  function  of  an  individual  component  of  (C-1), 

f^(^)  =|j|da  p{a)j’dx^exprifa  F(x)]-l]  +  1  .  (C-6) 

where  p(a)  is  the  probability  density  function  of  random  variable  aj^. 
Interchanging  integrals,  (C-6)  becomes 

fjCf) » 1 

where  f^  is  the  characteristic  function  of  amplitude  aj^.  Then  from  (C-1), 
since  all  the  individual  random  variables  are  independent,  the  characteristic 
function  of  I|^(t)  is 

fl  (?)  =  •  (C-8) 

K 

Finally,  the  characteristic  function  of  total  shot  noise  process  (1)  is,  by 
use  of  discrete  probability  distribution  (A-7)  for  random  variable  K,  given  by 
the  average 
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f,  (f)  = 

K=0 

=  exp[-vT  +  vT  fjCr)]  = 

=  expCvj]’dx{fg[fF(x)]-l]]  .  (C-9) 

The  (imprecise)  large  time  interval  T  has  dropped  out  of  the  general 
result  (C-9).  Also,  the  only  parameter  required  about  the  duration  random 
variable  is  its  mean.  The  exact  characteristic  function  f^  of 
amplitude  aj^  and  the  exact  pulse  shape  F  directly  affect  the  characteristic 
function  of  I(t).  =  1  for  all  k,  (C-9)  reduces  to  a  simplified 

version  of  [1,  eq.  1.5-4]. 

Cumulants  of  l(t) 

The  characteristic  function  of  random  amplitude  aj^  can  be  expanded  in  a 
power  series 

(C-10) 

n=0 

where  Wg(n)  is  the  n-th  moment  of  aj^: 

u^(n)  =  a”  =  J  da  a"^  p(a)  .  (C-11) 

Then  from  (C-9),  we  develop 
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in  f,(f)  .  vjjdx  {y|Flx)]-l} 


-  vj  “a(")  . 


(C-12) 


n=.l 

allowing  for  immediate  identification  of  the  cumulants  of  I(t)  as 

Xi(n}  -  V  J  y^(n)  J  dx  f"(x)  for  n  >  -  0  .  (C-13) 

For  =  1  for  all  k,  this  reduces  to  [1,  eq.  1,5-2]. 

The  normalized  cumulants  of  I(t)  are 

j  43(0)  Jdx  f"(x) 


(n)  =- 


_J _ 

Ki(2)T‘  (vJ*  '  |ua(2)Jdx 


(C-14) 


These  quantities  tend  to  zero  rapidly  for  vj  >>  1;  see  also  [1,  eq.  1.6-3]. 
Thus  vl  has  a  pronounced  effect  on  how  Gaussian  I(t)  is. 


Behavior  of  characteristic  function  fj(3^)  at  f -  *06 

If  pulse  F(x)  is  non-zero  only  over^x^,  have 

fdx[f^[rF(x)]-l}  =  J  [fjtFlx)]-!']  .  (C-15) 

J  X^ 

Now  if  random  variable  a^  has  a  characteristic  function  f,  with  the  property 

K  a 

that 

=  0  ,  (C-16) 
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2 

J  dx  {o-l}  =  -(x^  -  Xj)  as  f-*  (C-17) 


in  which  case  (C-9)  yields 


=  exp[-v^(x2  -  x^)] 


(C-18) 


If  pulse  extent  x^  -  x^^  is  infinite,  as  for  the  Gaussian  or  exponential 


pulses. 


F{x)  =  expC-x'^)  or  exp{-x)U(x)  , 


(C-19) 


then  (C-18)  is  zero.  On  the  other  hand,  if  X2  -  Xj  is  finite,  as  for  circular 


pulse 


F(x)  = 


(l-x^jfor  |x(  <  1 
0  for  jx|  >  1 


(C-20) 


fj{*9o)  s  exp[-vj2]  >  0  for  circular  pulse. 


(C-21) 


This  non-zero  characteristic  function  value  corresponds  to  an  impulse  at  the 
origin  of  probability  density  function  Pj,  with  area  {C-21).  Physically, 
this  means  that  there  are  occasionally  regions  of  the  t-scale  where  no  pulses 
overlap,  and  there  I(t)  =  0.  The  probability  of  this  happening  is,  generally. 


Pq  =  Prob  [l(t)  =  oj  =  «  exp[-vl(x2  -  x^)]  .  {C-22) 
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On  the  other  hand,  for  the  Gaussian  or  exponential  pulses  cited  in 
(C-19),  X2  -  =  +<«  ,  and  fj(±*)  =  0,  meaning  that  there  is  no  impulse 

at  the  origin  of  probability  density  function  Pj.  Physically,  the  infinite 
tails  (even  if  single-sided,  as  for  the  exponential  pulse)  disallow  I(t)  ever 
from  becoming  zero. 


Cumulants  of  Continuous  Portion  of  Pj. 


The  impulse  at  the  origin  means  that  probability  density  function  Pj 
and  cumulative  distribution  function  Pj  can  be  expressed  respectively  as 


PjCu)  =  S(u)  +  » 


u 

Pj(u)  *  pQ  J  Pc^^^  u  >  0,  (C-23) 

where  Pj.(u)  is  a  continuous  function  of  u,  with  area  1-Pq.  The 
characteristic  function  relation  corresponding  to  (C-23)  is 

fl(f)  =  Pq 


and  the  moments  are  related  according  to 


[iil(O)  -  Pg  for  n.O” 
Uj(n)  for  n^l 


(C-25) 


The  cumulants  of  f  or  p_  can  then  be  found  from  these  moments  (C-25),  by 

w 

recursive  relations;  see  [4]  or  [6J.  This  procedure  is  necessary  to  get 
accurate  series  expansions  for  the  probability  density  function  p^  and  its 
cumulative  distribution  function,  without  having  to  approximate  a  delta 
function. 
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In  the  case  where  pulse  extent  X2  -  Xj^  is  finite,  it  is  possible  to 
find  the  average  number  of  overlapping  pulses  at  any  one  time  instant;  this 
statistic,  denoted  byl^,  is  called  the  overlap  factor.  In  order  to 
determine  it  in  a  simple  fashion,  we  concoct  a  very  special  shot  noise 
process:  let 

aj^  =  1  for  all  k  , 


F(x)  =  1  for  Xj^  <  X  <  x^  . 


(C-26) 


Then  I(t)  is  a  step  function  with  amplitudes  limited  to  the  values 

0,  1,  2 .  Then  obviously,  the  average  number  of  overlapping  pulses  at 

one  time  instant  is  just 

=  TItT  =  vj  w^d)  j  dx  F(x)  =  V /(x^  -  x^)  ,  (C-27) 

upon  use  of  (C-13)  with  n=l  and  (C-26).  If  we  let 

r  =  I{x2-x^)  {C-28) 

denote  the  average  pulse  duration,  we  have  the  overlap  factor  in  the  form 

«  V  L  .  {C-29) 

For  the  Gaussian  or  exponential  pulses  in  {C-19),  we  have 
X2  -  Xj  *  +06,  giving  r  «  +«o ,  =  +*«.  This  is  in  fact  true,  since 

all  the  infinite  tails  overlap;  however,  it  is  not  then  an  informative 
statistic. 
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Closed  Form  Characteristic  Function  Examples 

There  are  a  couple  of  examples  of  the  circular  pulse  shape  F  and 
amplitude  characteristic  function  f^,  where  (C-9)  can  be  evaluated  in  closed 
form.  This  furnishes  an  alternative  to  the  moment  approach  [4]  used  here. 


Consider  the  circular  pulse  in  (C-20);  then  the  integral  in  (C-9)  is 
(using  (C-15)) 

J  [fa  [?(!-#}  =  2  do  COSO  fg[?coso]  -2  ,  (C-30) 

which  holds  for  any  characteristic  function  f..  Now  first  let  the 

a 

probability  density  function  of  aj^  be  exponential: 

p(a)  =^exp^‘^^  U(a)  ,  f^(^)  *  (1  -  .  (C-31) 

Substitution  in  (C-30)  yields 


2 


do  COSO 
l-ifug  COSO 


(C-32) 


But  we  know  that 

ir 

2  (*2  do  COSO 

^  l-z  cbso 


+ 


arc  tan 


arc  cos  (-2)  , 


(C-33) 


via  [5,  eqs.  2.554  2  and  2.553  3].  Then  letting  z  »  i^y^  and  using 
[2,  eqs.  4.4.2  with  4.4.26],  (C-32)  becomes 
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-2^(s-u-J)  +  iw(s-l) 


-2,  with  s 


4  ^ 


(C-34) 


Combining  these  results  in  (C-9),  the  closed  form  characteristic  function  is 


(C-35) 


which  holds  for  a  circular  pulse  F  and  an  exponential  probability  density 
function  p(a). 


The  second  example  is  the  one  considered  in  detail  here,  namely  the 
Rayleigh  probability  density  function  p{a)  given  in  (3).  First  substituting 
(C-30)  in  {C-9),  we  have  characteristic  function 


fj(f)  .  exp[2vJ(J(r)-l)] 


(C-36) 


where  integral  J(5*)  is  defined  as 


J(f )  a  d»  COSO  f  [/  coso] 


(C-37) 


For  Rayleigh  probability  density  function  (3),  (C-37)  can  be  expressed  as 
follows: 


j(f)  a  ^  do  COSO  da  exp{iaj  coso) 
0  0 


a  /.A 

•^a  V2°a/ 


Transform  to  rectangular  coordinates  according  to  a  cos  o  *=  ag  x, 
a  sin  o  s  og  y*  and  obtain 


(C-38) 


(C-39) 
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\L 

But  the  integral  on  y  here  is,  via  y  »  x  u  ,  equal  to 


the  latter  by  means  of  [5,  eq.  3.364  3].  Thus  (C-39)  becomes 


(C-40) 


(C-41) 


At  this  point,  we  have  two  alternatives.  First,  {C-41)  could  be 
efficiently  evaluated  for  all  ?  via  an  FFT;  the  decay  of  the  integrand  is 
according  to  exp{-u  )  for  large  u.  Secondly,  0(1*)  can  be  expressed  in  a 
closed  form  in  terms  of  a  hypergeometric  function;  specifically 

r  h  * 

+  b  exp(-b2)  -  i^{b2)]  ,  (C-42) 

where  b  =  ®a?/2*  The  upper  line  follows  from  [5,  eq.  6.755  6],  while  the 
lower  line  used  [5,  eq.  6.755  9]  with  an  application  of  partial  derivative 
9/3a  to  both  sides.  The  characteristic  function  fj  is  finally  obtained  by 
employing  (C-42)  in  (C-36). 


Still  another  alternative  is  afforded  by  use  of  the  closed  form  for  the 
characteristic  function  of  the  Rayleigh  probability  density  function,  as  given 
in  [7,  eq.  6]. 
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Moments  for  Some  Particular  Pulse  Shapes  F 


The  moments  of  pulse  shape  F  were  encountered  in  evaluating  the 
cumulants  Xj(n)  of  shot  noise  I(t),  according  to  (24)  or  {C-13)  as 

yp(n)  =  Jdx  f"(x)  for  n  ^  I  . 

For  circular  pulse  (C-20),  [5,  eq.  3.621  1]  yields  moments 


a  result  already  quoted  in  (29). 


More  generally,  for 


F(x)  = 


(l-x^)“  for  |x|  <  1 


0  for  jxj  >  1 
[5,  eq.  3.621  1]  yields,  with  a  trigonometric  substitution. 


u  (nl  -  o2nan  r^(na-»-l) 

^F^"^  -  2  r(&2l  • 


For 


F(x)  = 


[(cos  x)®  for  lx|  <  f  7 
0  for  jxj  > 


[5,  eq.  3.621  1]  yields  directly 


/„\  oOa  i  j 

2  ^(no^ly 


(C-43) 


(C-44' 


{C-45) 


(C-46) 


(C-47) 


(C-48) 
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For 


F(x)  s  x“  exp(-x)  U(x)  , 

n 

while  for 


F(x)  =  X®  exp(-x^/2)  U(x)  , 


Mp(n) 


(C-50} 


Both  relations  follow  directly  from  the  definition  of  the  P  function. 
Some  Probability  Density  Functions  for  Amplitude  ajf 
For  probability  density  function 


^  (C-51) 

we  have  characteristic  function 

fa(r)  =  (C-52) 

with  moments 

iia(n)  =  (y+Dp  for  n  ^  0  (C-53) 

and  cumulants 

=  (n-l)l  (y+I)  for  n  1  .  (C-54) 

This  example  subsumes  the  exponential  probability  density  function,  upon 
setting  y  »  0. 
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For  probability  density  function 


P(a) 


we  have  nnments 


(C-55) 


Uj(n) 


for  n  >  0  . 


(C-56) 


This  example  subsumes  respectively  the  one-sided  Gaussian  for  y=0,  the 
Raylei^  for  and  the  Maxwell  probability  density  functions  for  y=2.  The 
result  in  (29)  follows  immediately  by  setting  y=1,  o= 

a 


Convergence  of  Series  for  ^n  JLilil 


A  power  series  expansion  for  j^n  f  j(f)  was  developed  in  (C-12),  namely, 

>  fj(f)  -  Uj(n)  „p(n)  :  (C-57) 

n=l 

here  we  employed  (C-43).  Since  the  moments  in  (C-57)  can  be  easily  evaluated 
via  recursion,  according  to  results  in  the  above  two  subsections,  it  might  be 
thought  that  (C-57)  could  be  employed  to  evaluate  the  characteristic  function 
of  I(t)  directly,  without  recourse  to  the  more  difficult  approaches  required 
in  (C-9)  or  {C-35)  or  (C-36)-(C-42) . 


To  see  the  drawbacks  of  this  approach,  consider  first  a  circular  pulse  F 


and  a  generalized  exponential  probability  density  function  p(a)  as  in  (C-51); 
then  a  combination  of  (C-44)  and  (C-53)  yields,  for  the  n-th  term  of  the  sum 
in  (C-57), 
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=  "nKn^T-  * 


(C-58) 


Then  ratio 


-22  ^22 

J  a  ^  -Jo 


as  n-»  +*®, 


(C-59) 


regardless  of  the  value  of  y.  Therefore 


jfj  a  as  n  ->  +  •«  , 


(C-60) 


meaning  that  series  (C-57)  only  converges  for  } ji  <  1/a.  So  (C-57)  is  not  a 
viable  approach  for  the  calculation  of  the  characteristic  function  in  this 
case. 


As  a  second  example,  we  consider  the  circular  pulse  F  with  the 
generalized  Rayleigh  probability  density  function  in  (C-55).  Combination  of 
{C-44)  with  (C-56)  yields  for  the  n-th  term  of  series  (C-57), 


T  .  - ^  ‘  (1f«2)  . 

"  n!(nn);r(^) 


(C-61) 


Then  ratio 


n-^Y-1  T^o^ 


^n-2  n^-1 


as  n->  + 


(C-62) 


regardless  of  y.  Therefore 


(C-63) 
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meaning  that  series  (C-57)  converges  for  all/.  However,  direct  numerical 
evaluation  of  (C-57)  via  (C-61)  and  (C-62)  loses  all  its  significant  digits 
for  large  f,  long  before  j^n  fj{f )  reaches  its  final  value  of  -zjv  +  iO,  due 
to  the  alternating  character  of  the  series.  So  (C-57)  is  not  a  useful 
approach  for  evaluation  of  the  characteristic  function,  except  for  small  f. 
By  contrast,  the  series  expansion  technique  employed  in  [4]  uses  the  moments 
to  directly  estimate  the  desired  probability  density  function  and  cumulative 
distribution  function  of  interest,  for  large  arguments  as  well  as  small. 
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APPENDIX  D.  PROGRAMS  FOR  CUMULATIVE  DISTRIBUTION  FUNCTION 
AND  PROBABILITY  DENSITY  FUNCTION 

The  programs  used  here  to  evaluate  the  cumulative  distribution  function 
and  probability  density  function  of  shot  noise  are  listed  below.  The  n-th 
coefficient  in  a  generalized  Laguerre  expansion  of  orthonormal  polynomials  is 
denoted  by  b^  and  is  plotted  in  figure  0-1  for  n  =  0(1)70.  It  is  seen  to 
oscillate  and  decay  with  n  until  n  »  32,  at  which  point  round-off  error 
becomes  important;  however,  by  this  time,  jb^|  has  decayed  below  the  lE-5 
level.  The  round-off  error  is  so  dominant  beyond  n  =  35,  that  no  useful 
results  for  b^  can  be  obtained  then.  The  particular  parameter  values  (a,  a) 
used  for  the  Laguerre  weighting  are  indicated  in  the  listings. 
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10  1 

STEP  PLUS  CONTINUOUS  PRRT  OF  SHOT 

NOISE  CDF,  Pc'u', 

20  1 

Vlfl  GENERRLI2ED  LRGUERRE  E.'iPRNSION 

AND  MOMENTS 

3  0 

rT  =  70  '  MRXIMUM  ORDER  OF  RPPPO: I HRT  I  ON ;  NUMBER  OF  MOMErtT 

40 

DOUBLE  N,I,N,K  i 

INTEGERS  2  SI  = 

2 ,  14  7 

50 

RE  D  I  M  Morn  ■;  8 :  M  ,  R  0  :  M  > ,  L  ^  8 :  M  > 

60 

RERL  Morn 0 :  1 OO  >  ,  R  r  0 :  1  00 ,  L  ■  O ;  1  eo  • , 

t'  '1:21  ' 

70 

C  ft  L  L  M  c»  Hi  6  f'l  t  i- '  .  M 1  F'  y  1  f1 0  fH  *  ^  .*  * 

P0  IS  STEP  AT  GRIG 

IN 

90 

L-  €  t'l  t  >s  r  =  n  C'  fn  1  >  M  'It  fit  <.  y  *  I 

CENTER  OF  pc ■  u  ■ 

90 

R  2  =  N  o  fn  2  )  ■ '  M  o  tn  <  O  >  -  C  e  n  t  e  r  C  €•  n  t  e  r  ' 

MEAN  SOUARE  SFRERD 

0  F  f! 

100 

R  fi'i  'i-  =  S  Q  R  R  2  ‘ 

RMS  SPREAD  OF  pc ' u 

1  10 

fl  )  f  j  h  a0  =  C  t  r'l  t  e  r  *  C  t  rn  t  o  f  R  2  -  1  •  1 

THE  CHOICES  Alph 

a=  A  1  fj 

1  20 

B  e  t  aO  =  R  2  C  o  n  t  e  r  ' 

Eeta=Eeti0  WOULD 

MRt  E 

130 

R 1 pha= . 74 

140 

B€t-a=2.  1 

150 

1?  ‘•i L  C o e f  f  1  d  o  i  a  ni o m  •:  M  ,  R  1  p Fi  a ,  Be  t  a , 

Mofii '  *  ,  ft  ^  '  *  * 

DIF  EC 

160 

!  L  L  L  C  0  e  f  f  1  r  i  a  in  o  rn  C  M ,  R 1  fj  h  a .  B  €  t  a , 

Morn '  -  '  ,  A  '  +  ■  '  ' 

PEC  UR 

170 

PRINT  "Center  ==  Center 

180 

PRINT  "Rms  =";Rfn£ 

190 

fll=Ml pha+l . 

200 

01=1 .  Hi 

2 1 0 

F  1  =  1  .  ■  FNGatnrn  av  R  1  ) 

20 

DRTR  . 001 ,  .  002,  .  005,  . 01 , . 02, . 85,  .  1 

'f  ■‘j  ^  c 

_30 

DAT  fl  . 6 ,  . 7 , . 8 , . 9 , . 95 , . 93 , . 99 , , 995 , 

. 998, . 999 

240 

READ  Yv*) 

250 

FOR  1=1  TO  21 

260 

Y  <  I  ;>  =  F  N I  n ' .  '  p  h  1  <  Y  v  I  >  > 

270 

NEXT  1 

280 

Y1=Y-:;  1  > 

290 

Y2=Y ( 2 1 > 

300 

I NPUT  " ORDER  AND  LIMIT S : " , H , U 1 , L 

2 

310 

PRINT  "ORDER  AND  L I M I TS ; ” , N ; U 1 ; U2 

320 

Du= '  02-1.11  > -  lOO. 

330 

PLOTTER  IS  "GRAPHICS'' 

340 

GRAPHICS  ON 

350 

WINDOW  U1 , U2, Y1 , Y2 

3  b  0 

FOR  U=U1  TO  U2  STEP  'UC’-Ul)*.! 

3  70 

MOv’E  U,Y1 

330 

DRAW  U,Y2 

390 

ne:;t  u 

400 

FOR  1=1  TO  21 

410 

MO'v'E  Ul,Ya.' 

420 

DRAW  U2,Y':.  r> 

430 

NEXT  I 

440 

PENIJP 

458 

FDR  1=1  TO  100 

460 

U=Ul+Du*I 

470 

T=U ■ Beta 

480 

CALL  _  ague  r  r  e '  H  -  1 ,  A ,  T  ,  L  i  *  > 

4  90 

S  u  fii  =  A  0  F  N  F  1  1  '  A  1  ,  T  >  *  0  1 

500 

FOR  K=1  TO  N 

510 

S  u  (»  =  S  u  rn  +  A  '•  L  )  *  L  '  .  K  -  1  >  '  K 

520 

NEXT  K 

530 

P  =  P0  +  FlieEXP':>r  +  Al  ^LOG  •(  T  :■  >  *S>,'r„  i 

PROBABILITY  THAT  P 

V  .  IJ 

540 

IF  P>0.  AND  P<1.  THEN  570 

550 

PENUP 

560 

GOTO  580 

570 

PLOT  U  ,  FN  I  fi'  jph  i  ■  P  ) 

530 

NEXT  ! 

590 

PENUP 

600 

GOTO  300 

610 

END 

€20 

1 

■UIPED 
t  A  8 


fitfli 

,.  =  ft  ■■  2  .  = 


MOHEUT 

MOMENT 
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630  DEF  FN I n'.'ph i  ( X >  !  I NVPH I  <.K>  via  26.2.23  w i  t  h  mod i  f  1  c at  i  on 

640  D  =  K- .  5 

650  IF  fiBS<D>>.01  THEN  6«0 

660  P=2. 50662827463*D*< 1 . +D*D*1 . 04719755120) 

670  RETURN  P 

680  P  =  X 

690  IF  X>.5  THEN  P=l.-X 

700  P=SuRC-2. *L0G<P) ) 

710  T=1  .  +P*<:  1 . 432788  +  P*<  .  1 89269+P* .  00 1 308  )  > 

720  P=P-C2. 515517+P*< . 802853+P*. 010328) )/T 

730  IF  X<.5  THEN  P=-P 

740  RETURN  P 

"50  FNEND 

760  ! 

770  DEF  FNGammatX)  !  Ganima<X>  via  HHRT,  page  282,  #5243 

780  DOUBLE  N,K 

790  N=INT';X) 

800  R  =  X-N 

810  IF  N>0  OR  RO0.  THEN  840 

320  PRINT  "FNGammaCX)  IS  HOT  DEFINED  FOR  X  =  ";X 

830  STOP 

840  IF  R>0.  THEN  870 

850  G  aw  w  a2  = 1 . 

860  GOTO  940 

870  P  =  439. 33044406002567  6-*-R*(  50.  1 086937529709530 +  R  *6 . 7  44950724  59252899) 

880  P  =  8762. 7 10297852 1 4896  +  R^t  (2008. 52740 1  307279 12  +  R*P) 

890  P=42353. 6895097440896+R*<20886. 8617892698874+R*P) 

900  Q=499. 02S52662143904S-R»( 189. 498234 1 570280 1 6-R* ( 23 . 08 1 55 1 524580 1 25-R 

910  0  =  9940.  3074150S277090-R*< 1528. 60727377952202  +  R*Q) 

920  0  =  42353. 6S9509?440900  +  R*<2980. 38533092566499-R'*O> 

930  Gamma2=P-^Q  !  Gamma<2  +  R)  for  0  <  R  <  1 

940  IF  H>2  THEN  980 

950  IF  N<2  THEN  1030 

960  Gamnia=Gamma2 

970  RETURN  Gamma 

980  Gamma=Gamma2 

990  FOR  K=1  TO  N-2 

1000  Gamma=Gamrna*<X-K. ) 

1010  NEXT  K 

1020  RETURN  Gamma 

1030  R=l. 

1340  FOR  K=8  TO  1-N 

1050  R=R*<X+K) 

1060  NEXT  K 

1070  Gamma=Gamma2 -^R 

1080  RETURN  Gamma 

1090  FNEND 

1100  ! 
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1110  DEF  FNFll<ftl,X>  !  1 F  I 1 ;  ft  1  + 1 ;  X  > 

1120  DOUBLE  K 

1130  T=S=1. 

1140  FOR  K=1  TO  200 

1150  T=T*X^<fll+K) 

1160  S=S+T 

1170  IF  T<=1.E-17*S  THEN  RETURN  S 

1180  NEXT  K 

1190  PRINT  "200  TERMS  IN  FNFll  flT";Fll;X 

1200  RETURN  S 

1210  FNEND 

1220  ! 

1230  SUB  Laguerre < DOUBLE  N,REflL  fl  1  pha,  X ,  L <  *  >  >  !  Lri'  a1pha(X> 

1240  DOUBLE  K 

1250  Fll=fllpha-1. 

1260  L<0)=1. 

1270  L<l)=fllpha+1.-X 

1280  FOR  K=2  TO  N 

1290  L<K)  =  <  <K  +  K+fil-X)*L<K-l  >-<K  +  fll  >*L<K-2>  >-'K 

1300  NEXT  K 

1310  SUBEND 

1320  ! 

1330  SUB  Momnt  m i  a_c umnt  < DOUBLE  M,REflL  Cuiri (*),  Mom ■:  ■*•)  ) 

1340  DOUBLE  K,J 

1350  REAL  Mom0 

1360  Mom<0)=Mom8=EXPt. Cum<0>  > 

1370  FOR  K=1  TO  M 

1380  T=l. 

1390  S=Cum<K>*Mo(n0 

1400  FOR  .J=l  TO  K-1 

1410  T  =  T»<K-.J)-''J 

1420  S=S+T*Cum<K-J>*Mom< J) 

1430  NEXT  J 

1440  Mom(K)=S 

1450  NEXT  K 

1460  SUBEND 

1470  ! 
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1480 
1490 
1500 
1510 
1520 
1530 
1540 
1550 
1560 
1570 
1580 
1590 
1600 
1610 
1620 
1630 
1640 
1650 
1660 
1670 
1680 
1690 
1700 
1710 
1720 
1730 
1740 
1750 
1760 
1770 
1780 
1790 
1800 
1810 
1820 
1830 
1840 
1850 
1360 
1870 
1880 
1890 
1900 
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1920 
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1940 
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1  980 
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2050 
2060 
2070 
2080 


SUE  Coef  f  1  a_mom  C  DOUBLE  ■  ,  REAL  R  I  pha,  Bet  a,  Mom  <  ■*■  > ,  ft  ■ 

ALLOCATE  B<0;M> 

DOUBLE  K,Kl,J,Mx 
T=1 . 

FOR  K=1  TO  M 
T=T*<ft1pha+K)*Beta 

Mom<K)=riom‘:;K>  •■•T  !  NORMALIZED  MOMENTS,  RELATIVE  TO  Alpha  AND  Bel 

NEXT  K 

Q=l. 

R<0>=B<0)=Mom<0) 

FOR  K=1  TO  M 

Kl=k+1 

T=l. 

S=Mom<3> 

FOR  J=1  TO  K 
T=T*<J-K1 >xj 
S  =  S  +  T'*Mofi>(J) 

NEXT  J 

Q  =  Q*  <  ft  1  pha+K  )  -'  K 
A<K)=S 

B(K>=S*SQR<Q) 

NEXT  K 
Mx=Mx+10 

IF  Mx<M  THEN  1700 
Thresho 1 d=-7 . 

T2=Thresho1d*2. 

V=10.  •^Threshol  d 
GINIT 

PLOTTER  IS  "GRAPHICS" 

GRAPHICS  OH 

WINDOW  0. ,FLT<Mx),T2,0. 

LINE  TYPE  3 

FOR  J=0  TO  Mx  STEP  10 

MOVE  J,T2 

DRAW  J,0. 

NEXT  J 

FOR  J=T2  TO  0 
MOVE  0. , J 
DRAW  Mx,J 
NEXT  J 
PENUP 

LINE  TYPE  1 

IMAGE  4D, 2(4K, M. 17DE> 

PRINT  "  K  B<K>  Sun." 

Suri.=0 . 

FOR  K=0  TO  M 
B=B<K> 

Su(ri=Sum  +  B*B 

PRINT  USING  1900;K,E,Sum 
IF  B<V  THEN  2000 
Y=LGT<B> 

GOTO  2040 

IF  E>-V  THEN  2030 

Y=T2-LGT<-B) 

GOTO  2040 
Y=Thresho 1 d 
PLOT  K,Y 
NEXT  K 
PENUP 
SUBEND 
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2090  SUE  Coeff  1  r_'v'i  a_fiiom(' DOUBLE  (1,RERL  fl  1  pha,  Bet  a,  Mom  <  *  > ,  fl  <  *  >  > 

2100  RLLOCRTE  BCOsM) 

2110  DOUBLE  K,Kl,J,Mx 

2120  T=l. 

2130  FOR  K=1  TO  M 

2140  T  =  T*c;fll  pha+K>*Beta 

2150  Mom':;K::'=Moni(:K:.'.-'T  !  N0RMRLI2ED  MOMENTS,  RELRTIVE  TO  Alpha  AND  Bet 

2160  NEXT  K 

2170  Q=l. 

2180  fl0=fi<0>=B<0>=Mom(:0> 

2190  FOR  K=1  TO  M 

2200  K1=K+1 

2210  T=l. 

2220  S=Mom<K)-R0 

2230  FOR  .J=l  TO  K-1 

2240  T  =  T*<J-K1  )/.J 

2250  S=S-T*RCJ> 

2260  NEXT  J 

2270  IF  K  MOD  2=1  .N  S=-S 

2280  Q  =  Q*(fllpha+K.)xK 

2290  R(:K>=S 

2300  E(:k>=s*sqr(:q) 

2310  NEXT  K 

2320  Mx=Mx+10 

2330  IF  Mx<N  THEN  2320 

2340  Threshol d=-7. 

2350  T2=Thresho1 d*2. 

2360  V=  10.  •''Threshol  d 

2370  GINIT 

2380  PLOTTER  IS  "GRAPHICS" 

2390  GRAPHICS  ON 

2400  WINDOW  0. ,FLT(Mx),T2,0. 

2410  LINE  TYPE  3 

2420  FOR  J=0  TO  Mx  STEP  10 

2430  MOVE  •J,T2 

2440  DRAW  J,0. 

245  NEXT  J 

2460  FOR  J=T2  TO  0 

2470  MOVE  0.,J 

2480  DRAW  Mx,.J 

2490  NEXT  J 

2500  PENUP 

2510  LINE  TYPE  1 

2520  IMAGE  4D, 2<4X, M. 17DE> 

2530  PRINT  "  K  E';:K)  Sum" 

2540  Sum=0. 

2550  FOR  K=0  TO  M 

2560  E  =  E'tK) 

2570  Sum  =  Surn  +  B*B 

2580  PRINT  USING  2520 ;K,B, Sum 

2590  IF  B<V  THEN  2620 

2600  Y=LGT<B) 

2610  GOTO  2660 

2620  IF  B>-V  THEN  2650 

2630  V=T2-LGT(-B> 

2640  GOTO  2660 

2650  Y=Thresho!d 

2660  PLOT  K.,Y 

2670  NEXT  K 

2680  PENUP 

2690  SUBEND  59 

2700  ! 
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2710  SUB  Mornents-CDOUELE  MjREflL  P0,Mom<*>>  !  SHOT  NOISE 

2720  O'v'er  1  ap  =  6.2  !  flV.  NO.  PULSES/SEC  *  fiVERRGE  PULSE  DURfiTI 

2730  Sigmaa=l.  !  PflRRMETER  OF  RAYLEIGH  AMPLITUDE  PDF 

2740  P0=EXP<-OMerl ap>  '  PROBABILITY  OF  ZERO  AMPLITUDE  OF  SHOT  NOISE 

2750  ALLOCATE  Cum<0;M>  !  ARRAY  FOR  CUMULRNTS 

2760  DOUBLE  K 

2770  S=S  i  i3riiaa*S  i  groaa 

2780  Cuni<0>=0. 

2790  Cum  C  1  >  =0'v'er  1  ap*S  i  gmaa*  .  25*P  I*SQR'' .  5*PI  > 

2000  C  u  m  '■  2 )  =  0  u  e  r  1  af i  *  S  *  4 .  3 . 

2810  FOR  K>3  TO  M 

2020  C  u  m  <  K  >  =  C  u  rn  <  K  -  2  >  *  S  *  K  *  K  ■  <  K  + 1  > 

2030  NEXT  K 

2840  CALL  Momnt_'v‘  i  a_':  umnt.  <  M  ,  Cum  >:  *  >  ,  MotfK  *  >  > 

2050  Mom ( 0  J  =Mom ( 0 ) ~P0 

2060  SUEEND 


10 
20 
30 
40 
50 
60 
70 
80 
90 
100 
110 
120 
130 
140 
1 50 
1  fe'0 
170 
100 
190 
200 
210 
220 
230 
240 
250 
260 
270 
280 
290 
300 
310 
520 
330 
340 
350 
360 
370 
380 
390 
400 
410 
420 
430 


!  CONTINUOUS  PART  OF  SHOT  NOISE  PDF,  pc<u>,  VIA 
I  GENERALIZED  LAGUERRE  EXPANSION  AND  MOMENTS 

!  MAXIMUM  ORDER  OF  APPROXIMATION;  NUMBER  OF  MOMENTS  REQUIRED 
DOUBLE  N,I,H,K  i  INTEGERS  <  Z'vSl  =  2,147,483,643 

R  E  D I M  M  o  m  <  0 ;  M ) ,  A  <  0 ;  M ) ,  L  <  0 :  M ) 

P0  IS  STEP  AT  ORIGIN 
CENTER  OF  pcvu) 

MEAN  SQUARE  SPREAD  OF  pc<u> 

RMS  SPREAD  OF  pcc:u> 

THE  CHOICES  A 1 pha= A 1 phaO  AND 

Eeta=Beta0  WOULD  MAKE  Af:i>=R<2>=0 

Alpha=,74 
Bst a=2. 1 

LALL  Cc>6 f  f  1  i  a_rriom  ( M ,  a  1  pha,  Bet- a,  Morn < * >  ,  a < * >  >  !  DIRECT  MOMENTS 

!  LALL  L-oef  f  1  i  a^rnom  <  M ,  A 1  pha,  Bet- -a,  Mom  ( *  > ,  A  C  ■*•  > )  i  RECURSIVE  MOMENTS 

PRINT  "Center  =  Center 
PRINT  "Rms  ="*Pms 
F 1  =  1 .  ''  Be  t  a*FHG.amn'i -a'-!  A 1  fjh a+ 1 .  >  ) 

INPUT  "ORDER  AND  L  I M  I TS: " , N , U1 , U2 
PRINT  "ORDER  AND  L I M I TS ; " , N ; U 1 ; U2 
Du=OJ2-Ul .)  ■-100. 

H  =  4.  .•■■(U2-U1  > 

PLOTTER  IS  "GRAPHICS" 

GRAPHICS  ON 
WINDOW  U1 , U2, -H*. 1 , H 
GRID  CUZ-Ul  1 ,  H*.  1 
PLOT  0.,0. 

FOR  1=1  ro  100 
U=Ul+Du*I 
T=U.-Beta 

CALL  Lag u e  r r e H ,  A 1  p h a ,  T  ,  L  t  *  iO 
Sum  =  A(,0> 

FOR  K=1  TO  H 
S  u  m  =  S  u  m  +  A  K  >  *  L  <  K  > 

NEXT  K 

P  =  F  1  »EXP<; -Tt-Al  pha*LOG<  T;' ^ifSum  !  PDF  OF  RV  AT  U 
PLOT  U,P 
NEXT  I 
PENUP 
GOTO  200 
END 


r.cnu  nont i  oo  ,>  ,  n  y :  1  yo  J  ,  L  t.  0  ;  1  00 

L  A  L  L  M  0  m  e  ri  t  s-  ( M ,  P  0 ,  M  o  m  *  )  ) 

C  e  fi  t  e  r  =  M  o  m  '■  1  >  •  •  M  o  m  t!  0  > 

R  2  =  M  o  fi'i 2  >  M  o  m  ( 0 )  -  C  e  n  t  e  r  #  C  e  fi  t  e  r 

R  m  5-  =  S  Q  R  i  R  2 , ' 

A 1  p  V‘i  a0  =  C  e  n  t  e  r  *  C  e  n  t  e  r  ■  ••-  R  2  - 1 . 

B  e  t  .a0  =  R  2  ■  -  C  e  n  t  e  r 
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Generalized  Laguerre  Series 
Employing  High-Order  Expansion 
Coefficients  Determined 
Recursively  via 
Moments  or  Cumulants 


A.  H.  Nuttail 

ABSTRACT 

High-order  series  expansions  of  probability  density  functions  and 
cumulative  distribution  functions,  in  Hermite  as  well  as  generalized 
Laguerre  orthogonal  polynomials,  have  been  obtained,  where  the 
weighting  functions  in  both  cases  can  have  arbitrary  (mismatched) 
parameter  values. 

The  high-order  expansion  coefficients  for  both  the  Hermite  and 
generalized  Laguerre  series  can  each  be  obtained  by  any  one  of  three 
fast  recursive  procedures  (all  of  which  have  been  programmed,  and  for 
which  program  listings  are  presented).  The  forms  of  these  three 
recursive  procedures  differ  in  the  Hermite  versus  Laguerre  cases; 
however,  they  are  basically  either  convolutions  or  finite  alternating 
series  with  binomial  coefficients.  Accuracy  of  the  three  procedures  is 
compared.  Numerous  examples  of  series  expansions  of  probability 
density  functions  and  cumulative  distribution  functions  are  given. 
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ABSTRACT 


High-order  series  expansions  of  probability  density  functions  and  cumu¬ 
lative  distribution  functions,  in  Hermite  as  well  as  generalized  Laguerre 
orthogonal  polynomials,  have  been  obtained,  where  the  weighting  functions  in 
both  cases  can  have  arbitrary  (mismatched)  parameter  values;  that  is,  the  two 
free  parameters  a  and  B  in  the  weightings 

w{u)  =  —pL —  expf-  ~  \  for  all  u,  Hermite 

w{u)  =  u  >  0,  generalized  Laguerre 

8  r{a  +  1) 

need  not  be  chosen  so  that  the  first  two  expansion  coefficients  b^  and  b2  in 
the  orthonormal  series  are  zero.  (The  zero-th  order  expansion  coefficient  bg 
is  never  zero.)  Nonetheless,  all  the  available  N  lowest-order  moments  of  the 
approximating  probability  density  function  are  maintained  identical  to  those 
of  the  given  probability  density  function,  regardless  of  the  weighting  employed 
and  any  of  its  free  parameter  values. 

It  has  been  discovered  that  deliberate  mismatch  of  a  and  6  results  in 
faster-decaying  coefficient  sequences  (bp)^  than  when  a  and  B  are  chosen  to 
make  b^  =  b2  *  0,  which  is  a  common  choice.  For  example,  the  central  limit 
theorem  is  just  such  a  case,  where  a  and  B  in  the  Hermite  expansion  are  taken 
as  the  mean  and  standard  deviation,  respectively,  and  the  number  of  moments 
employed  is  limited  to  just  order  N  =  2. 

A  fast  trial-and-error  procedure  is  used  in  general  to  determine  good 
values  of  weighting  parameters  a  and  B.  The  only  statistics  needed  about  the 
given  probability  density  function  or  cumulative  distribution  function  are 
either  its  moments  or  cumulants,  through  order  N.  Furthermore,  all  the  results 
presented  actually  apply  to  functions  which  have  arbitrary  area  (not  necessarily 
equal  to  unity)  and  to  functions  which  can  become  negative.  In  fact,  one  of 
the  applications  considered  is  to  a  shot  noise  process  where  the  continuous 
part  of  the  probability  density  function  has  area  less  than  1,  and  which  is 
well  approximated  by  a  generalized  Laguerre  series  expansion. 

The  high-order  expansion  coefficients  for  both  the  Hermite  and  generalized 
Laguerre  series  can  each  be  obtained  by  any  one  of  three  fast  recursive  proce¬ 
dures  (all  of  which  have  been  programmed,  and  for  which  program  listings  are 
presented) : 

(a)  recursively  via  cumulants, 

(b)  directly  via  moments, 

(c)  recursively  via  moments. 
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The  forms  of  these  three  recursive  procedures  differ  in  the  Hermite  versus 
Laguerre  cases;  however,  they  are  basically  either  convolutions  or  finite 
alternating  series  with  binomial  coefficients.  The  occurrence  and  quantitative 
value  of  round-off  error  for  large  N  is  easily  discerned  in  a  plot  of  the 
expansion  coefficient  sequence  for  each  choice  of  a  and  s,  and  for  each  of  the 
three  procedures,  as  well  as  for  both  types  of  series  expansions. 

Comparisons  of  the  accuracy  of  the  three  alternative  recursive  procedures 
reveals  that  expansion  coefficients  determined  recursively  via  cumulants  are 
generally  most  accurate  and  least  susceptible  to  round-off  error.  Numerous 
examples  of  series  expansions  of  probability  density  functions  and  cumulative 
distribution  functions  are  given,  including  one  with  N  =  150  terms,  where  the 
last  expansion  coefficient  is  of  size  lE-10  relative  to  the  leading  coefficient 
bg.  Estimates  of  the  error  associated  with  the  approximations  obtained  by  the 
Hermite  and  generalized  Laguerre  series  are  derived  and  compared  with  results 
of  several  examples. 
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n-th  generalized  Laguerre  polynomial;  (96) 

Confluent  hypergeometric  function 

Auxiliary  variables  in  (112) 

Recursively  via  Cumulants 
Directly  via  Moments 
Recursively  via  Moments 
Parameters  of  p  in  (141) 

Generalized  Q-f unction;  (165) 

Area  of  impulse  at  origin  of  p,  for  shot  noise 
Hypergeometric  function 
Envelope  function 

Estimated  error  of  p^;  (178)  or  (183) 

Estimated  error  of  P^;  (180)  or  (185) 
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EVALUATION  OF  DENSITIES  AND  DISTRIBUTIONS  VIA  HERMITE  AND  GENERALIZED 
LAGUERRE  SERIES  EMPLOYING  HIGH-ORDER  EXPANSION  COEFFICIENTS 
DETERMINED  RECURSIVELY  VIA  MOMENTS  OR  CUMULANTS 

INTRODUCTION 

In  the  theoretical  analysis  of  performance  of  some  systems  with 
nonlinearities  and/or  memory,  it  often  happens  that  the  only  statistics  about 
the  decision  (or  output)  random  variable  of  interest  that  can  be  easily  found 
are  the  moments,  or  in  other  cases,  the  cumulants.  Explicit  relations  for  the 
low-order  expansion  coefficients  in  Edgeworth  or  Gram-Charlier  series  are 
available  in  terms  of  the  available  moments  or  cumulants  [1,  pp.  172  and  191], 
[2,  pp.  223  and  226],  [3,  pp.  157  and  159].  However,  for  higher-order  moments 
and  cumulants,  these  explicit  nonrecursive  relations  are  very  tedious  to 
derive,  become  extr^iely  lengthy,  and  are  not  practical  to  use. 

We  will  address  the  problem  of  obtaining  accurate  high-order  series 
expansion  approximations  of  the  probability  density  function  and  cumulative 
distribution  function  of  a  random  variable  of  interest,  in  terms  of  the 
available  moments  or  cumulants  of  that  random  variable.  The  necessity  of 
being  able  to  approximate  probability  density  functions  and  cumulative 
distribution  functions  from  knowledge  of  either  the  moments  or  the  cumulants, 
is  that  some  physical  problems  have  these  particular  statistics  as  natural  and 
convenient  starting  points.  For  example,  if  a  physical  processor  sums 
together  a  number  of  independent  Rician  random  variates,  the  characteristic 
function  and  cumulants  of  the  individual  random  variables  or  their  sum  are  not 
available  in  any  useful  analytic  form;  however,  the  nigh-order  moments  of  an 
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individual  Rician  variate  can  be  easily  and  accurately  evaluated  by 
recurrence,  and  thereby  the  moments  of  the  sum  can  be  obtained.  Conversely, 
for  shot  noise  with  random  amplitude  and  duration  modulation,  the  probability 
density  function  is  not  readily  available,  whereas  the  characteristic  function 
is,  and  the  cumulants  are  simple  to  evaluate  [4,  appendix  C]. 


The  particular  series  expansions  we  employ  are  based  on  the  two  special 
classes  of  weighting  functions 


w(u)  =  — exp^  - 1  for  all  u 

(2ir)0  \  28  / 


Hermite 


(1) 


and 


„(U)  .  for  u  >  0 


6“  ‘  r(a'^l) 


generalized  Laguerre.  (2) 


The  orthonormal  polynomials  associated  with  these  weightings  are  directly 
related  to  the  Hermite  and  generalized  Laguerre  polynomials,  respectively 
[5,  22.2.15  and  22.2.13],  The  weightings  each  have  two  free  parameters,  a  and 
8,  which  can  be  manipulated  to  advantage  in  obtaining  finite  (high-order) 
series  expansions  which  well  approximate  a  given  (unknown)  probability  density 
function  and  cumulative  distribution  function. 

The  question  of  when  a  set  of  moments  uniquely  determines  the  probability 
density  function  is  a  difficult  one;  see,  for  example,  [3,  pp.  109-112  and 
179].  Also,  the  convergence  of  the  series  is  very  involved  [2,  pp.  223  and 
258],  [3,  pp.  161-163].  But,  even  if  the  series  is  divergent,  use  of  a 
limited  number  of  expansion  coefficients  often  gives  a  satisfactory 
approximation  to  the  desired  probability  density  function  [3,  p.  167].  We 
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presume  here  that  the  moments  do  uniquely  determine  the  probability  density 
function  and  are  buoyed  in  that  respect  by  the  comment  [3,  p.  87]  that  most 
distributions  in  statistical  practice  do  possess  this  property. 

The  main  idea  in  the  series  expansion  approach  here  is  not  necessarily  to 
get  as  many  terms  as  possible,  but  rather  to  get  as  rapid  convergence  as 
possible  of  the  series.  If  a  particular  choice  of  weighting  parameters  a  and 
0  results  in  sufficiently  small  expansion  coefficients,  say,  at  order  10,  this 
is  better  than  another  choice  of  a  and  $  where  20  or  30  terms  are  required  for 
the  same  size  coefficients.  In  fact,  if  a  and  e  could  be  chosen  such  that  the 
series  terminated  (zero  coefficients)  after  a  few  terms,  that  would  be  ideal; 
however,  this  is  not  the  case,  and  in  fact,  the  choice  of  o  and  b  requires 
some  trial-and-error  to  achieve  rapidly  decreasing  coefficients. 

The  expansion  coefficients  of  a  given  probability  density  function,  in  an 
orthonormal  set  of  Hermite  or  generalized  Laguerre  polynomials,  are  denoted  by 
l^n*\o»  where  N  is  the  number  of  available  or  known  moments  or  cumulants. 

Very  often,  the  choice  of  o  and  a  in  (1)  or  (2)  has  been  made  such  that 
b^  =  0  and  b2  =  0,  for  purposes  of  analytic  simplicity  and  for  hopeful 
early  termination  of  the  series;  see  for  example  [1,  pp.  171  and  191], 

[2,  p.  223],  [3,  p.  159].  However,  it  will  be  demonstrated  that  this  is 
generally  not  the  best  choice,  and  that  more  rapidly  decaying  coefficients  can 
be  achieved  by  other  (mismatched)  values  of  o  and  b,  which  must  be  searched 
for  numerically;  this  possibility  is  also  mentioned  in  [3,  p.  164].-  In  fact, 
an  example  will  be  given  which  illustrates  that  the  choice  of  parameters  a  and 
B  to  make  expansion  coefficients  bj^  and  62  zero,  can  in  fact,  lead  to  a 
divergent  Hermite  seHes. 
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Depending  on  the  available  information  about  the  probability  density 
function,  i.e.,  moments  or  cumulants,  a  variety  of  methods  will  be  given  for 
determining  the  expansion  coefficients  particular,  for  both  the 

Hermite  and  generalized  Laguerre  series,  we  can  get  the  coefficients  by  three 
different  procedures: 

(a)  recursively  via  cumulants, 

(b)  directly  via  moments, 

(c)  recursively  via  moments. 

The  reason  for  having  these  alternatives  is  that  the  calculation  of  expansion 
coefficients  (b^‘\  for  high-order  n  invariably  runs  into  large  round-off 
error.  In  order  to  reduce  this  round-off  error,  the  amount  of 
number-crunching  on  the  computer  should  be  minimized,  and  any  spurious 
transformations  between  moments  and  cumulants  should  be  avoided  if  possible. 
Thus  it  is  desireable  to  have  techniques  which  can  accomplish  the  desired  goal 
of  evaluating  expansion  coefficients  {b^|  as  directly  as  possible  from  the 
available  information.  The  use  of  different  alternatives  also  enables 
comparisons  of  the  computed  expansion  coefficients  and  thereby  furnishes 
quantitative  assessment  of  the  amount  of  round-off  error.  Recursive 
inter-relationships  between  moments,  central  moments,  and  cumulants  are  given 
in  [6],  including  cases  of  two  dependent  random  variables. 
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FUNDAMENTAL  EQUATIONS 

DEFINITION  OF  STATISTICS 

Suppose  a  function  p  has  known  moments* 

'^n  "  j' 0  £  n  £  N  .  (3) 

The  function  p  need  not  have  unit  area,  i.e.,  Mq  ^  1  is  allowed,  and  p  can 

become  negative  at  some  arguments  u.  Nevertheless,  for  convenience,  and  since 

most  of  our  applications  are  to  random  variables,  we  shall  refer  to  p  as  a 

probability  density  function,  and  to  its  running  integral 

a 

P(u)  =  r  dt  p(t)  (4) 

—<0 

as  a  cumulative  distribution  function.  We  shall  presume  that  uq  >  0  in  all 
cases. 

The  characteristic  function  corresponding  to  probability  density  function 
p  is  the  Fourier  transform 

f(i5)  =  J  du  exp(igu)  p(u)  .  (5) 

When  f  is  expanded  in  a  power  series,  the  result  is 

f(i5)  =  ^  (6) 

n=0 


*  Integrals  without  limits  are  over  the  range  of  nonzero  integrand. 
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in  terms  of  the  moments  in  (3).  Alternatively,  if  J&i  f  is  expanded  in  a  power 
series, 

«o 

In  f(i;)  =  ^  ^  (i5)"/n:  ,  (7) 

n=0 

where  the  quantities  are  the  cumulants  of  p  or  f.  Observe  that 
generally,  to  the  lowest  three  orders. 


Xq  =in  f(0)  =  in  uq  ^  0  , 


The  available  information  on  probability  density  function  p  will  be 
either 

moments  or  cumulants 

Whichever  is  available,  we  wish  to  get  high-order  accurate  approximations  to  p 
and  cumulative  distribution  function  P  in  (4);  that  is,  values  of  N  in  the 
order  of  10  to  100  are  of  interest. 
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WEIGHTING  FUNCTION  PROPERTIES 

We  select  a  nonnegative  weighting  function  w  such  that 

w(u)  >  0  at  least  where  p(u)  ^  0  .  (10) 

We  also  disallow  any  impulses  in  w.  The  moments  of  weighting  w  are  defined 
analogously  to  (3)  as 

=  J  du  u*^  w(u)  for  n  ^  0  ;  (11) 

it  is  presumed  that  these  quantities  can  be  evaluated  for  as  large  n  as 
required. 

Suppose  weighting  w  has  r  free  parameters  (plus  a  scaling  parameter).  It 
might  then  seem  beneficial  to  choose  them  such  that  the  moments  of  w  and  p  are 
approximately  equal, 

s  for  1  <  n  <  r  (plus  Vq  2  Wq)  .  ( 12) 

for  then  the  abscissa  scales  of  w  and  p  would  tend  to  match.  However,  (12) 
will  turn  out  to  be  not  so  desireable,  and  the  choice  of  the  r  weighting 
parameter  values  should  be  based  on  another  criterion.  The  ordinate  scale  of 
w  is  actually  immaterial,  since  the  expansion  coefficients  {b^^  will  absorb 
this  scaling;  so  henceforth  we  presume  that  vq  =  1  with  no  loss  of 
generality. 
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APPROXIMATION  PROCEDURE 


Let  be  any  n-th  order  polynomial,  and  approximate  probability 
density  function  p  by  function 

N 

Pm(u)  =  w(u)  ^  b„  Q„(u)  where  w(u)  >  0  , 


where  ^^^0  expansion  coefficients.  Define  weighted  squared 

error 


Ef^  =  J  du  y(u)  [p(u)-Pfj(u)]^  = 


r  Ji-  2 

=  du  y(u)  [p(u)-w(u)  b  Q-iu)]^  , 

n=0  "  " 


(13) 


(14) 


where  error-weighting  y  is  nonnegative.  If  we  minimize  Ej^  by  choice  of 
expansion  coefficients  there  follows  the  set  of  linear  equations 

b^  Idu  y(u)  w^(u)  Q|^(u)  Q^(u)  =*  j  du  y{u)  w{u)  p(u)  Qj^(u)  for  0  <  k  <  N. 

In  order  to  use  only  the  available  infonnation  in  (9)  about  p,  the  right-hand 
side  of  (15)  must  simplify  according  to  the  selection 


1/ 

y(u)  =  where  w(u)  >  0  (and  arbitrary  elsewhere).  (16) 

Furthermore,  since  constant  K  merely  scales  error  Ej^,  and  appears  on  both 
sides  of  (15),  we  can  set  K  =*  1  without  loss  of  generality.  Then  (14)  becomes 
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(17) 


and  (15)  reduces  to 


(18) 


In  general,  this  is  N+1  simultaneous  linear  equations  in  the  N+1  unknowns 
{b^'^Q.  The  choice  Q|^(u)  =  u*^  would  lead  to  an  apparently  simple  set 
of  equations,  when  (11)  and  (3)  are  used.  However,  a  few  numerical  examples 
quickly  reveals  that  they  are  very  ill-conditioned,  due  to  the  character  of 
the  nondiagonal  matrix  with  elements 

J'du  w(u)  Q(((u)  Qf,(u)  for  0  <  k,n  <  N  (19) 

that  appears  on  the  left-hand  side  of  (18).  In  order  to  avoid  the  significant 
round-off  error  associated  with  solving  such  a  system  for  large  N,  we  choose 
^nio  ^  orthonormal  polynomials  with  respect  to  weighting 

w;  i.e.,  (19)  is  1  for  k  =  n,  and  0  otherwise.  Also  recall  that 
vq  =  J du  w(u)  =  1  without  loss  of  generality. 


Equation  (18)  then  reduces  to  an  explicit  relation  for  the  expansion 
coefficients: 


for  0  <  k  <  N  , 


(20) 


and  (17)  for  the  error  becomes  merely 


(21) 


9 


TR  7377 


It  will  be  presumed  that  the  integral  in  (21)  is  finite;  otherwise,  the 
error  would  be  infinite,  which  is  a  meaningless  problem.  This  will  put  some 
restrictions  on  the  parameter  choices  of  weighting  w,  since  this  error 
integral  depends  on  these  parameters  as  well  as  on  the  given  probability 
density  function  p.  The  sum  of  squares  in  (21)  must  then  be  bounded,  and  in 
fact  affords  a  measure  of  the  adequacy  of  approximation  (13),  by  saturating 
(at  an  apriori  unknown  value)  for  large  N. 

As  N  increases,  the  values  of  the  lower-order  expansion  coefficients 
change.  Therefore  they  only  have  to  be  computed  once 
and  do  not  have  to  be  revised  as  more  terms  are  added  in  series  approximation 
(13),  i.e.,  larger  N. 


EQUALITY  OF  PROBABILITY  DENSITY  FUNCTION  MOMENTS 


A  very  important  property  of  expansion  (13)  is  obtained  as  follows: 


J  du  q|^(u)  pj^(u)  =  Jdu  Q|^(u)  w(u) 
=  b|^  =  J du  Q|^(u)  p(u)  for  0  _<  k 


bn  Q„(u)  = 


I 

(22) 


where  we  used,  in  order,  (13),  the  orthonormality  of  (19),  and  (20).  But 
since  is  a  k-th  order  polynomial,  relation  (22)  states  that  approximation 
Pfj  has  exactly  the  same  moments  as  given  probability  density  function  p, 
from  order  0  through  order  N.  This  matching  of  moments  between  probability 

density  functions  pj^  and  p  has  been  achieved  regardless  of  the  weighting  w 
and  its  particular  parameter  values.  Furthermore,  (22)  holds  independently  of 
whether  the  weigh ting -moment  equalities  in  (12)  are  satisfied  or  not. 
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The  cumulative  distribution  function  corresponding  to  approximation  Pj^ 
is  defined  as 

N 

Pf^(u)  s  j  dt  Pjj{t)  «  ^  J  dt  w{t)  Q^(t)  .  (23) 

Its  Utility  depends  on  getting  closed  forms  and  simple  recursions  for  the 
general  integral  on  the  right-hand  side. 

PARAMETERS  OF  GIVEN  PROBABILITY  DENSITY  FUNCTION  p 

The  moments  of  p  were  defined  in  (3).  It  is  useful  to  define  three 
important  parameters  of  p: 

Area  A  =  Jdu  p(u}  =  Uq  (mq  >  0,  but  need  not  be  1); 


2  2 

(Conversely,  wq  =  A,  =  AM,  ug  *  A(M  +R  ).)  These  parameters 
depend  on  the  probability  density  function  p  that  we  are  trying  to  approximate 
and  can  be  coiT^)uted  from  the  available  information  (9).  They  are  useful  for 
determining  where  the  major  concentration  of  p(u)  lies  on  the  u-scale,  and 
have  obvious  physical  interpretations. 

In  terms  of  the  cumulants  of  p  defined  in  (5) -(8),  we  have  the 
alternative  expressions 
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'/i 

A  =  exp{>;j),  R=X2  .  (25) 

or  conversely 

n  u  /u 

7^^  » in  wq  =  A,  ^  »  M.  7^2  “ 

GENERAL  RESULTS  FOR  THREE  LOWEST-ORDER  POLYNOMIALS 

The  weighting  function  w  and  associated  orthonormal  polynomials  satisfy 
the  following  equation: 

Jdu  w(u)  Q,^(u)  Q^(u)  »  .  (27) 

Also  we  have  weighting  moments 

Vn  »  j'du  u"  w(u),  with  vq  =  1  .  (28) 

It  is  then  a  straightforward  matter  to  evaluate  the  three  lowest-order 
orthonormal  polynomials: 

Qo(u)  =  1  , 

Ql(u)  -  » 

Q2(u)  «  |u^(v2-v^)  -  u(v2-V2Vj^)  +  ('*3''i”''2)J  »  (^^^ 

where 
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The  general  expansion  coefficients  in  (20)  then  become 
^0  =  *^0  ’ 

1  r  2  2 '] 

^2  “  07  t‘2^'’2‘''l^  ■  *‘l^''3"''2''l^  *"  ‘'0^Vr''2^J  ’ 

All  these  results  above  are  general  and  make  no  presumption  about  weighting 
moment  equalities  such  as  (12). 

SPECIAL  CHOICES  OF  WEIGHTING  PARAMETERS 
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Conversely,  (31)  shows  that  requiring  bj^  »  0  forces  the  choice  in  (32A)  for 
Thus  equality  of  the  first  weighting  moment  of  w  with  the  first 
(normalized)  moment  of  probability  density  function  p  implies  (and  is  implied 
by)  the  vanishing  of  the  first  expansion  coefficient  bj^.  This  may  or  may 
not  be  a  useful  choice,  but,  whether  adopted  or  not,  has  no  bearing  on  the 
equality  of  probability  density  function  moments  already  demonstrated  in  (22). 

As  a  second  special  choice,  suppose  that  weighting  w  has  enough  free 
parameters  that  we  can  vary,  so  as  to  make  the  mean  locations  and  rms  widths 
of  w  and  p  coincide  (see  (24));  that  is 

Ul  Up 

let  V,  =  ~  and  v,  =  —  .  (33A) 

1  "0  2  "o 

(Again  we  have  used  vq  =  1.)  Manipulation  of  (31)  yields  the  following 
conclusion: 

then  b^  =  0  and  b2  *  0  .  (338) 

Conversely,  imposition  of  (338)  implies  the  results  in  (33A),  as  may  be  seen 

by  reference  to  (31).  (The  apparent  additional  solution 
2  2  2 

■^2  *  ^‘l/‘*0  "  '^l  yield  an  impulse  for  w  and  is  disallowed.)  Thus 

equality  of  the  first  two  weighting  moments  of  w  with  the  first  two 
(normalized)  moments  of  probability  density  function  p  implies  (and  is  implied 
by)  the  vanishing  of  the  first  two  expansion  coefficients  b^  and  b2.  This 
common  choice  of  weighting  parameter  values  can  be  made  if  desired,  but  is  not 
necessary  (or  recommended)  for  series  approximations  by  orthonormal 
polynomials.  The  equality  of  probability  density  function  moments  in  (22) 
will  hold  whether  (33)  is  true  or  not. 
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EXAMPLE  OF  DIVERGENT  ERROR  INTEGRAL  FOR  =  0,  b2  =  0 


As  a  demonstration  of  what  forcing  expansion  coefficients  b^  and  b2 
equal  to  zero  can  do,  consider  probability  density  function 

2  u^  exp(-u^/<u^) 


p(u)  = 


for  u  >  0 


(y  >-!,«>  0) 


(34) 


with  moments 


„r(^) 

"" '  “  WT  ■ 


(35) 


This  class  of  probability  density  functions  includes  the  one-sided  Gaussian, 
Rayleigh,  and  Maxwell  as  special  cases,  for  y  =  0.  1*  2,  respectively. 


Consider  also  the  Hermite  weighting  given  in  (1),  which  has  moments 
(11)  equal  to 

Vq  =1,  ®  '^2  “  0^+0^  .  (36) 

If  we  now  insist  on  property  (338),  then  (33A)  yields 


But  the  leading  integral  in  minimum  error  E^j  in  (21)  is  convergent  only  if 
p^(u)/w(u)  decays  sufficiently  rapid  for  large  u.  We  have  from  (34)  and 
(1),  the  dominant  behavior 


P^(u)/w(u)<jC  exp^ - 


9  2  2 
2u  +  u 


for  large  positive  u  , 

whereoC  denotes  proportionality,  but  disregards  the  exact  scale  factor  and 
subdominant  behavior.  Thus  the  integral  in  (21)  is  convergent  only  if 


(38) 
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4b 


1  <  2(Yn) 


(39) 


However,  calculation  of  (39)  reveals  that  this  inequality  is  never  satisfied 
for  any  value  of  y  >  -Ij  the  function  on  the  right-hand  side  starts  at  0  when 
Y  =  -1,  and  increases  monoton i cal ly  towards  1  as  y  ►  behaving  like 
1  -  1/(4y)  in  this  limit. 


Thus  expansion  of  probability  density  function  (34)  according  to  a 
Hermite  weighting  has  an  infinite  error  integral  (21)  (and  perhaps  a  divergent 
series  expansion)  regardless  of  the  values  of  y  and  u  in  the  true  probability 
density  function,  if  we  insist  on  expansion  coefficients  bj^  =  b2  =  0.  Yet 
if  we  relax  requirement  (338),  and  choose  B  according  to  (39)  such  that 
B  >  u/2,  the  error  integral  in  (21)  is  certainly  finite,  regardless  of  o. 


However,  making  the  error  integral  in  (21)  finite  is  not  the  whole  story, 
in  so  far  as  realizing  useful  approximations  to  the  probability  density 
function  or  cumulative  distribution  function.  An  example  of  probability 
density  function  (34)  was  taken  with  y  =  3,  u  =  1.  When  a  and  b  were  chosen 
according  to  (33)  and  (37)  (giving  8  =  .48  <  .5  =  (d/2),  the  expansion 
coefficients  [b^^  initially  decreased  to  approximately  lE-3  at  n  =>  40  terms, 
and  then  diverged;  yet  a  plot  of  the  approximate  exceedance  distribution 
function  obtained  by  a  Hermite  expansion  overlaid  the  exact  answer  down  to  the 
lE-16  level.  On  the  other  hand,  when  the  weighting  parameters  in  the  Hermite 
expansion  were  chosen  as*  a  =  0,  b  =  .7  >  .5  =  u/2,  giving  bj^  ^  0  and 


♦This  is  example  8  in  a  later  section 
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b2  i  0,  the  expansion  coefficients  decreased  to  the  IE -4  level  at 
n  =  70  before  round-off  error  became  dominant;  despite  this  apparent 
improvement  in  coefficient  level*  the  approximate  exceedance  distribution 
function  overlaid  a  plot  of  the  exact  result  down  to  the  lE-10  probability 
level,  which  is  several  orders  of  magnitude  worse  than  the  above  result.  Thus 
emphasis  on  getting  a  convergent  error  integral  in  (21)  may  not  always  be 
desired. 

For  Hermite  weighting  (1)  and  the  class  of  probability  density  functions 
which  decay  as  exp(-u‘^)  as  u  >  +<*6,  the  error  integral  is  always  convergent 
if  q  >  2,  and  always  divergent  if  q  <  2.  So  an  exponential  probability 
density  function,  like  u^  exp(-u/u»)  for  u  >  0,  always  yields  a  divergent 
error  integral  when  expanded  in  a  Hermite  series. 

For  generalized  Laguerre  weighting  (2),  it  is  necessary  to  consider 
u  =  0+  and  u  =  separately.  If  probability  density  function  p  behaves  like 
u^  as  u  >  0+,  then  a  finite  error  integral  requires  that  we  choose 

a  <  1  +  2y.  Coupled  with  the  finite  area  restriction  on  weighting  w,  a  range 

of  values  of  a  is  allowed,  namely,  -1  <  o  <  1  +  2y;  this  range  always  exists 

since  y  >  -1  is  necessary  for  the  probability  density  function  itself  to  have 

finite  area. 

If  also  the  probability  density  function  behaves  as  expC-ii/w)  as  u  > 
then  a  finite  error  integral  with  generalized  Laguerre  weighting  requires  that 
we  choose  p  >  o)/2.  So  the  range  of  choice  of  8  is  open  on  the  large  side, 
whereas  that  for  o  is  a  limited  one,  for  this  particular  class  of  probability 
density  functions. 
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HERMITE  EXPANSION 


In  this  section,  we  will  deal  exclusively  with  weighting  (1), 


w(u)  «  d  all  u  {$  >  0)  , 


where 


-/i 


^(x)  =  (2ir)  exp(-x^/2),  ^(x)  =  j^dt  d(t)  . 

This  weighting  has  two  free  parameters,  a  and  a,  and  moments 


(40) 


(41) 


Vq  =1,  =  a,  \»2  »  .  (42) 

If  and  V2  are  specified,  the  parameters  must  then  sa'*-isfy  a  »  vj^, 

2  1/2 

6  =  (v2  -  '  .  However,  we  shall  keep  a  and  b  general  and  unspecified. 

PROPERTIES  OF  POLYNOMIALS  AND  EXPANSIONS 

The  orthonormal  polynomials  associated  with  weighting  (40)  are  the 
Hermite  polynomials  [5,  22.1.2  and  22.2.15] 


Q^(u)  =  (nl)  for  n  >  0  . 

The  expansion  coefficients  are  given  by  (20)  as 

=  J  du  p(u)  Q^(u)  =  (nl)“^^^  c^  for  n  >  0  , 


(43) 


(44) 
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where  we  define 

Cn  »  J  du  p{u)  n  ^  0  • 

The  approximate  probability  density  function  then  follows  from  (13)  in  the  form 

N  N 

p„(u).w(u)  2  ^  ,  (46) 

n=0  n=0 

where  we  used  (40),  (43),  (44),  and  defined 

(n!)^^^  *n  "  *^n  for  n  0  .  (47) 

These  three  different  coefficients  in  (44)-(47)  are  introduced  for  convenience 
in  further  equation  manipulations.  Expansion  coefficient  b^  is  the 
geometric  mean  of  auxiliary  coefficients  a^^  and  c^^  (with  polarity). 

Expansion  (46)  is  also  called  a  Gram-Charlier  series  of  type  A  [2,  p.  222], 

[3,  p.  156]. 

The  approximate  cumulative  distribution  function  corresponding  to  (46)  is 
u.  N 

P,(U)  .  f  dt  p,(t)  >  2  4„  j"  f  <  (V)  (V)  = 

n=0 

NT  N 

.  ^  a  r  dx  d(x)  He^(x)  =  |(T)  -  i(T)  ^  a_, 

n»0  — n=l 

where 

J  =  ^  (49) 

and  we  used  (41)  and  [5,  22.11.8]. 
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The  Hermite  polynomials  fHe^ satisfy  the  recurrence  [5,  22.7.14] 

He^{x)  *  X  He^_j^{x)  -  (n-1)  He^_2(x)  for  n  2  ,  (50) 


with  starting  values  HeQ(x)  =  1,  Hej^{x)  =  x  [5,  22.3.11].  The  highest- 
order  term  in  He^(x)  is  x*^,  with  coefficient  1  [5,  22.1.2  and  22.3.11]. 

The  magnitude  of  the  term  multiplying  in  (46)  has  an  envelope  that  decays 
approximately  as  n"^^^  with  n,  regardless  of  argument  u.  This  may  be  seen 
by  using  (47)  and  (49)  to  get 


a„  He„(T)  .b„(n;rl'2  He„(T)cC  b„(n 


bn/2  ^-r 


(b/e)"'2  =  b„ 


as  n  >+oft,  for  all  T,  (BOA) 


where  we  also  used  [5,  6.1.39  and  22.5.18]  and  [7,  8.22.8].  Here,oC  denotes 
proportionality  and  we  have  taken  the  magnitude  of  the  terms;  the  exact  scale 
factor  of  proportionality  will  be  presented  in  a  later  section  where  the 
errors  of  the  approximations  are  estimated.  So  if  b^  were  to  decay  faster 
than  n“'^^^,  the  probability  density  function  series  in  (46)  would  converge 
absolutely. 


Conditions  are  better  for  the  cumulative  distribution  function  series  in 
(48);  namely,  based  on  the  above  result,  there  follows  (for  the  envelope) 

oC  n“^^^  n"^^^  =  b^  n“^^^  as  n  >•  for  all  T  .  (508) 

Thus  if  b^  decays  faster  than  the  cumulative  distribution  function 

series  converges  absolutely.  Furthermore,  if  the  leading  error  integral  in 
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p 

(21)  is  finite,  the  sum  of  must  be  finite,  meaning  that  must  decay 
faster  than  So  we  can  conclude  that  if  the  error  integral  is  finite, 

the  Hermite  series  for  the  cumulative  distribution  function  in  (48) 
converges.  (Notice  that  this  particular  decay  n"^/^  of  b^  is  not 
sufficiently  fast  to  make  the  same  conclusion  about  the  Hermite  series  for  the 
probability  density  function  in  (46).)  The  above  are  sufficient  conditions  on 
expansion  coefficients  and  are  not  necessary. 

EXPANSION  OF  CHARACTERISTIC  FUNCTION  f 


The  coefficients  a^  and  c^  were  defined  in  (45)  and  (47).  Then  the  sum 


where  f  is  the  characteristic  function,  and  where  we  used  (45),  [5,  22.5.19 
and  22.9.17],  and  (5).  Letting  w  =  3Z,  we  have 

f(z)  expLz  -  I  ^  (sz)"  =  ^  ^  ■  (52) 

n=0  n=0 

Thus  {a^]  and  {c„^  are  the  coefficients  in  these  power  series  expansions 
of  the  function  f(z)  exp(-az  -  where  f  is  the  characteristic 

function  corresponding  to  probability  derisity  function  p,  and  a  and  8  are 
arbitrary.  A  special  case  of  (52)  is  given  in  [2,  17.6.10]. 


21 


TR  7377 


Collecting  (46)  and  (52)  together  for  comparison,  and  assuming  that 
Pp  »  p  as  N  ►  we  have 

p(u)  =  j  ^  a„ 


n=0 


f(if)  =exp^ar-^0¥^  ^  a^(i3?)"  . 

^  n=0 


(53) 


Thus  expansion  of  probability  density  function  p  in  an  infinite  Hermite  series 
is  equivalent  to  an  expansion  of  a  modified  form  of  the  characteristic 
function  in  a  power  series,  according  to  (53).  Equations  (51)-(53)  will  serve 
as  very  convenient  starting  points  for  the  derivation  of  several  alternative 
recurrences  for  the  expansion  coefficients  (a^}.  Notice  that  weighting 
parameters  o  and  a  are  completely  unrestricted  in  (52)  and  (53),  except  that 

3  >  0. 


An  analogous  result  holds  for  N  finite,  but  must  be  derived  in  a 
different  fashion,  because  we  no  longer  can  use  infinite  sum  [5,  22.9.17]. 
Define  the  Fourier  transform  of  (46)  as  the  N-th  order  approximation  to  the 
characteristic  function: 

f,^(i?)  =  exp(ifu)  Pfj(u)  » 

n*0 

N 

»  ^  ®n  exp(if«  +  ifat)  i(t)  He^(t)  » 
n»0 

-  exp(ia5)  ^  a^  rdtexp(i3ft)  ^(t)  « 

n-0  ^ 
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=«  exp(io5)  ^  (i65)"  i  dt  exp(i$5t)  d(t)  = 

n=0 

=  exp/iaf  + -j  ^  (ie?)”  ,  (54) 

where  we  used  [5,  22.11.8]  in  line  4,  and  repeated  integration  by  parts  in 
line  5.  This  result  is  the  leading  N  terms  of  (53).  As  a  by-product  of  this 
derivation,  we  have 

Jdt  exp(2t)  d(t)  He^(t)  »  •  (55) 

COEFFICIENTS  RECURSIVELY  VIA  CUMULANTS 


We  are  now  in  a  position  to  obtain  some  useful  recursive  relations  for 
the  expansion  coefficients  (a^^)  in  (51)-(54).  The  first  one  is  obtained  by 
taking  the  of  (51): 


Then  using  (7)  and  identifying  the  right-hand  side  of  (56)  as  a  new  power 
series,  we  have 

o*  _  ,  .  n 


n5*0 


(57) 


n=0 
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There  follows  immediately 


for  n  ^  1,2 


for  n  “  1 


for  n  =  2 


But  equality  of  the  right-hand  sides  of  (56)  and  (57)  also  requires  that 


^  '’n  “"]• 

n=0  ln=0  J 


It  is  shown  in  appendix  A  that  a  recursive  solution  to  (59)  for  the  (a^^  is 


given  by 


>n  f 

n  n  ^ 


^  ®n-(n  ^  ®0  =  • 


Then  eliminating  ^h^^^  by  means  of  (58), 

"n  *  ^  (f  -  l)  ^-1  "  ""-2  *  ^ 


- — _  a  for  n  >  1, 

(m-l)i  b"* 


&Q  =  expCJ^Q.! 


where  =  0  for  n  <  0,  and  the  sum  is  zero  for  n  <  3. 


Now  define  normalized  cumulants  (excluding  n=0)  according  to 


=  — _!3 -  for  n  >  1  . 

^  (n-l)i  b" 
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Then  (61)  becomes 


n 

“  n  16^“  ?)  ^n-1  ^  ^n-2  ^  ^  ^n-m 

^  m=3 


for  n  >  1  , 


aQ  »  exp(>^)  . 

This  convolution  is  the  desired  recursion  for  expansion  coefficients 
via  cumulants. 


As  particular  cases,  we  have 


=  0  *0« 


o  p  _ 


(64A) 


Parameters  o  and  0  (>0)  are  completely  arbitrary  in  the  above  three  equations, 
and  Q  are  the  available  cumulants  of  the  probability  density  function 
under  consideration. 


Observe  that  if  we  choose  a  =  Xi  =*  M  and  0  =^2^^  =  R  (see  (24) -(25)), 
which  is  a  very  conmon  choice,  we  have  aj^  =  0  and  a2  =  0;  this  is  a 
special  case  of  the  general  property  (33)  stated  earlier.  This  special  choice 
of  o  and  0  corresponds  to  choosing  the  mean  location  and  rms  width  of  ^termite 
weighting  (40)  identical  to  those  same  parameters  of  the  given  probability 
density  function.  There  then  also  follows,  in  this  special  case. 


1  ^  1  •v  1  ^ 

®3“'3^®0’  *4"'4^®0*  ^^®0  * 


r  n 

®n  ”  rT  ^  ®0  ^  ^  ®n-m 

m=3 


for  0^6  when  «  “Xj*  8  =^2  ^  *  (648) 
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COEFFICIENTS  DIRECTLY  VIA  MOMENTS 


Before  we  begin  this  derivation,  we  present  the  following  useful 
expansion  [5,  22.9.17  and  22.5.19]: 

exp(-|y^  +  xy)=  ^  He„(x)  y"  . 


(65) 


naO 


We  now  again  refer  to  (51)  and  expand  the  terms  as  follows: 

^  a„  w"  -  exp(-  i  w2  -  I  w)  f(f)  - 


n^=0 


Co 


:-,hyth-A€- 


(66) 


k=0  m=0 

where  we  utilized  (65)  and  (6).  Equating  coefficients  of  w'^  on  both  sides 
of  this  equation,  we  have 

n 


for  n  >  0  . 


(67) 


We  now  define,  for  convenience,  the  normalized  Hermite  pol^momials 


^  He„(x)  for  n  2  0  » 

n  n  ♦  n 


(68) 


and  the  normalized  moments 


’^n 

" - 


for  n  >  0  . 


(69) 


n!  B 


(Notice  the  difference  with  the  definition  of  the  normalized  cumulants  (62).) 
Then  (67)  becomes 
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n 


ks'O 


for  n  >  0  , 


(7U) 


which  gives  expansion  coefficients  directly  in  terms  of  the 
(normalized)  moments  of  the  given  probability  density  function.  The 
recurrence  in  (50)  can  be  used  to  generate  the  Hermite  factors  needed  in 
convolution  (70).  Parameters  a  and  8  (>0)  of  weighting  (40)  are  arbitrary. 
Heo(x>  1.  He,(x>  X,  Hejx>  ftr  ^52. 

As  particular  cases,  we  have 


Ul  -  CllQ 

®0  “  ‘‘0*  =  8  * 


Oo  = 


U2  -  2auj^  +  (a^-B^)  Uq 

2b^ 


(71) 


These  agree  with  (64)  which  utilized  cumulants.  If  we  make  the  special  choice 

2  2 

of  «  =  wi/vq  P  =*  ^zho  ”  *  0  and  a2  »  0. 


An  alternative  more  direct  derivation  of  (67)  is  possible:  from  (47), 
(45),  (B-3)  in  appendix  B,  and  (3), 


for  n  >  0  . 


(72) 
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COEFFICIENTS  RECURSIVELY  VIA  MOMENTS 


Before  we  begin  this  derivation,  we  replace  x  >  -ix,  y  >  iy  in  (65)  to  get 

expA  y^  +  xy)  =  5  nT  5  Hi^(x)  y'’  ,  (73) 

'  n»0  ’  n-0  * 

where  ^ii,^(x)  is  a  real  n-th  order  modified  Hermite  polynomial  in  x  defined  by 

Hi^(x)  =  i*^  Hej^(-ix)  for  n  >  0  .  (74) 

The  recursion  for  these  polynomials  follows  immediately  from  (50)  as 

Hi^(x)  =  X  Hi^_j^(x)  +  (n-1)  n  2  ,  (75) 

with  starting  values  HiQ(x)  =  1,  Hij(x)  =  x.  The  difference  with  (50)  is 

2 

the  polarity  of  the  last  term;  thus  for  example,  Hi2(x)  =  x  +1, 

Hi2(x)  =  x^  +  3x,  versus  He2(x)  =  x^  -  1,  He3(x)  =  x^  -  3x. 


We  novy  rew’"ite  (51)  in  the  following  form: 

f(j)  -  e*p(i  *1")^  ’m""  • 


Expanding  in  power  series  by  means  of  (6)  and  (73), 


n=0 


k*0 


m»0 


Equating  coefficients  of  w  ,  there  follows 


or 


1 

ITT 


*n-k 


for  n  2  0  . 


(76) 


(77) 


(78) 
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The  approximations  to  the  probability  density  function  and  curtwlative 
distribution  function  are  given  by  (46)  and  (48),  respectively,  where  a  and  s 
are  arbitrary  constants,  except  that  s  >  0.  The  functions  ^  and  $  are  defined 
in  (41),  while  the  Hermite  polynomials  are  available  via  (50).  The 

expansion  coefficients  {a^^  are  given  by  the  three  alternatives  (63),  (70), 
(81),  in  terms  of  normalized  cumulants  (62),  normalized  moments  (69), 
normalized  Hermite  polynomials  (68),  and  normalized  modified  Hermite 
polynomials  (80)  and  (74).  Programs  for  all  three  alternative  procedures  for 
determining  expansion  coefficients  [a^}  are  listed  in  an  appendix.  The 
basis  for  these  relations  is  the  characteristics  function  expansion  in 
(51)  >(53). 
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GENERALIZED  LAGUERRE  EXPANSION 


This  section  will  treat  weighting  (2),  namely. 


«(u)  ,  for  u  >  0 

e*  ^  r(.n) 


(a  >  -1,  B  >  0), 


(82) 


This  weighting  is  a  special  case  of  the  three-parameter  weighting 

for  u  >  T  . 


(u-y)®  exp^-y^ 
r(an) 


(83) 


which  is  the  most  general  scaled  linear  shift  of  the  generalized  Laguerre 
weighting  [&»  22.2.12] 

X®  exp(-x)  for  x  >  0  .  (84) 


We  will  consider  only  y  =  0  here.  For  a  probability  density  function  Pq(u) 
which  is  known  to  be  nonzero  only  for  u  >  Uq,  we  would  consider  the  modified 
probability  density  function  p(u)  ==  Pq{u+Uq),  because  then 
p(u)  4  0  only  for  u  >  0,  and  the  simpler  weighting  (82)  would  be  directly 
applicable.  This  procedure  is  equivalent  to  choosing  y  =  Uq  in  the 
three-parameter  weighting  (83)  above,  and  requires  knowledge  of  Uq.  We 
presume  that  p(u)  4  0  only  for  u  >  0  henceforth  in  this  section,  and  that  any 
necessary  shifting  has  already  taken  place. 

Idteighting  (82)  has  two  free  parameters,  a  and  b,  and  moments 

=»  n  2  0  .  (85) 
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In  particular. 


Vq  »  1,  Vj^  a*  (o'*‘1)b,  V2  «  {o+2){a'*‘l)B^ 


If  vj^  and  ^2  specified,  then  the  parameters  must  satisfy 


^  1  a  2  1 

2  -1  ,  8 - - - 

''2  -  n  1 


However,  we  shall  keep  a  and  b  general  and  unspecified  except  for  the 


conditions  in  (82). 


PROPERTIES  OF  POLYNOMIALS  AND  EXPANSIONS 


The  orthonormal  polynomials  associated  with  weighting  (82)  are  the 
generalized  La guerre  polynomials  £5,  22.1.2  and  22.2.12] 


Qp(u)  -  L 


for  n  >  0,  u  >  0  . 


The  expansion  coefficients  are  given  by  (20)  as 


>n-r 


du  p(u)  Q^(u) 


for  n  >  0 


where  we  define 


co 

^  du  p(u)  for  n  >  0  . 


The  approximate  probability  density  function  follows  from  (13)  according  to 
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N 

p^(u)  =  w(u)  ^  Q„(u)  = 


,  u- exj)l:y,/e),  A  a  for  u  >  0  ,  (91) 

6“  ‘r(an)  S5  " 

where  we  used  (82),  (88),  (89),  and  defined 


These  three  different  coefficients  in  (89)-(92)  are  introduced  for  convenience 
in  further  equation  manipulations.  Expansion  coefficient  is  the 
geometric  mean  of  auxiliary  coefficients  a^  and  c^^  (with  polarity). 


The  approximate  cumulative  distribution  function  corresponding  to  (91)  is 
u.  ..  u 


'H(u)  =  Idtp,(t).  i  a„  fdt 

0  B  I  (a+1)  ' 


1 

r(«+i) 


fL 


^  ^n  ?)  ^0"  ‘^  >  0  . 


(93) 


where  we  define 


I  (y)  =*  r  dx  X®  e“^  L^“^(x)  for  n  >  0,  y  >  0  . 
n  ^  n 


(94) 


These  quantities  are  evaluated  in  appendix  C;  when  substituted  in  (93),  they 
yield  (95) 


(u/s)“^^  exp 

(-u/g) 

PT 

for  u  >  0, 


where  is  the  confluent  hypergeometric  function. 
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The  generalized  Uguerre  polynomials  satisfy  the 


recurrence 


[5.  22.7.12] 

L^®^(x)  »  •j[(o-l+2n-x)  L^“i{x)  -  (a-l+n)  for  n  >  2  ,  (9( 

with  starting  values  L^q^(x)  =*  1,  L^®^(x)  =  o+l-x  [5,  22.4.7].  The  highest 

order  term  in  L^®\x)  is  {-x)^/n;  [5,  22.1.2  and  22.3.9];  this  is  distinctly 

different  from  the  coefficient  1  for  the  Hermite  polynomials.  Yet  the 
envelope  decay  with  n  of  the  generalized  Laguerre  series  for  the  probability 
density  function  and  cumulative  distribution  function  are  identical  to  those 
of  the  Hermite  series,  for  u  >  0.  To  prove  this,  use  (91)  and  (92)  to  get 


n  n  U, 


as  n  >  +«>,  for  u  >  0  , 


where  we  also  used  [5,  6.1.39]  and  [7,  8.22.1],  Again,  «C denotes 
proportionality  with  n  only;  the  exact  scale  factor  will  be  presented  in  a 
later  section  where  the  errors  of  the  approximations  are  estimated.  So  if 
b^  decays  faster  than  the  probability  density  function  series  in 

(91)  converges  absolutely. 


For  the  generalized  Laguerre  series  of  the  cumulative  distribution 
function  in  (95),  we  have,  for  the  envelope  of  the  general  term. 
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L 


(o+l)M 

n-1  ( 


L 


1  ^  _  1 

oCb  -  (n““Y  (n-1)  ^  ^  b  as  n  >■  +“«,  for  u  >  0  .  (98) 

Thus  if  b^  decays  faster  than  (95)  converges  absolutely.  And  if 

the  error  integral  (21)  is  finite,  this  property  of  the  {b^}  is  true.  So  if 
error  integral  (21)  is  finite,  the  generalized  Laguerre  series  for  the 
cumulative  distribution  function  converges  absolutely  for  u  >  0;  this  is  a 
sufficient,  but  not  necessary,  condition. 


For  zero  argument,  the  generalized  Laguerre  polynomials  behave 
differently  for  large  n.  From  [5,  22.4.7  and  6.1.39], 


(99) 


Then  (97)  and  (98)  are  both  replaced  by  bj,  n®^^  as  n  >  +«*.  However,  for 
a  >  0,  the  probability  density  function  in  (91)  is  zero  at  u  =<  0  due  to  the 
u®  term,  so  there  is  no  need  to  perform  the  sum  then.  And  the  cumulative 
distribution  function  is  always  zero  at  u  =  0,  again  eliminating  the  need  to 
evaluate  the  sum  in  (95).  So  the  difference  in  behavior  at  u  »  0  is  of  no 
consequence . 
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EXPANSION  OF  CHARACTERISTIC  FUNCTION  f 

The  coefficients  and  c^  for  the  generalized  Laguerre  series  were 
defined  in  (90)  and  (92).  Then  the  sum 


«  ^  ao 

S  c  ^  1  L^“^(u/8)  = 

n=0  "  n«0  *^0  ” 

=  j^du  p(u)  ^  w"  L^“^(u/b)  =  p(u)  (1-w)"®”^  = 

-  f(^)  . 


(100) 


where  f  is  the  characteristic  function,  and  where  we  used  (90),  [5,  22.9.15], 
and  (5).  Thus  {c^^  are  the  expansion  coefficients  of  the  right-hand  side  of 

(100)  in  powers  of  w.  If  we  let  w  =  .  we  have  the  expansion  for  the 


characteristic  function 


(101) 


corresponding  to  given  probability  density  function  p.  Weighting  parameters  a 
and  6  are  arbitrary  in  (100)  and  (101). 


Collecting  (91)  and  (101)  together  for  comparison,  and  assuming  that 
Pm  »  p  as  N  >  +"o,  we  have,  upon  use  of  (92), 


u“  e«p(-u/8)  ^  l{.)/u'v  for  u  >  0  , 

8“*^  r(»H)  SS  "  " 


f(if)  .  (l-i8f)' 


(.+1) 


n  /-131 


n  n: 


L-ief; 


(102) 
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Thus,  expansion  of  probability  density  function  p  in  an  infinite  generalized 
Laguerre  series  is  equivalent  to  an  expansion  of  the  corresponding 
characteristic  function  in  the  series  of  the  particular  form  in  (102). 
Equations  (100) -(102)  will  serve  as  very  convenient  starting  points  for  the 
derivation  of  several  alternative  recurrences  for  expansion  coefficients 
We  reiterate  that  a  and  6  are  arbitrary  in  the  above,  except  that 

a  >  -1,  $  >  0. 


An  analogous  result  holds  for  N  finite,  but  must  be  derived  differently 
since  we  can  no  longer  use  infinite  sum  [5,  22.9.15],  Define  the  Fourier 
transform  of  (91)  as  the  N-th  order  approximation  to  the  characteristic 
function: 


r 


ffj(i?)  =  exp(ifu)  pj^(u)  = 

d,  exp(1?u)  i  a„  L 

^  P(a+1)  n=0  " 


r(a+l) 


N 


a^  j^dt  exp(iBft)  t“  e~^  L^“^(t)  . 


In  appendix  D,  it  is  shown  that 

dt  L<“>  rt>  V 

.  n  V  /  n ;  / 1  •  V  o+ 


e» 


(1-iu,) 


o^l+n 


(103) 


(104) 


Substitution  in  (103)  then  yields 


Vi?) 


N 


(a+1) 

nT“ 


nLzMll 

(1-i 8?) 


o+l+n 


(l-iBlV^^ 


(105) 


where  the  last  relation  follows  by  use  of  (92),  This  result  is  the  leading  N 
terms  of  (102). 
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COEFFICIENTS  RECURSIVELY  VIA  CUMULANTS 


We  can  now  obtain  some  useful  recursive  relations  for  expansion 
coefficients  ^a^^  and/or  in  (100)-(105).  We  start  by  taking  the 


of  (100): 


w'’^  =  -(o+l)  in(l-w)  +^n  • 


(106) 


Identify  the  left-hand  side  as  a  new  power  series,  and  use  (7)  and  [5,  15.1.8] 
to  yield 


i  h„  w"  =  (an)  iiw" *  S  ^  (f^)'  = 

n=n  ^  n=1  "  k=0  ^  / 


=  (o+l)  2.  ^  w"  +  2 


- T —  w  w  . 


V  ui  X  i  \  fT  I  »»  • 

n=l  k=0  k:  6*^  m=0 

Equating  coefficients  of  wi^,  there  follows  hp  =Xo,  while  for  n  1, 


H  1,  ...  .  ^  ‘"’n-k 


+  1+  ^  (-1) 


(O^k]  • 


(107) 


(108) 


where  we  used  the  normalized  cumulants  defined  in  (62). 


But  since  the  left-hand  sides  of  (106)  and  (107)  are  equal,  we  have 


occ  c  w"  =  exp 
n=0  " 


or  via  appendix  A,  the  recurrence 


IS  "■  ■•]  ■ 


(109) 
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Finally,  define 

d  =  m  h^  for  m  >  1  (111) 

mm  — 

for  notational  convenience  and  thereby  obtain 

(k)^  form>l, 

‘n  -  n  ^  “m  ’=n-r,  i  '=0  = 

by  means  of  (108)  and  (110),  respectively.  Equation  (112)  is  a  recursive 
relation  for  expansion  coefficients  ^c^  in  terms  of  cumulants  and 
auxiliary  variables  {d^}.  The  [a^^  are  immediately  available  via  (92). 


As  particular  cases,  we  have,  employing  (62), 

'1  '  ■^)'o  ’ 


.«i2i .  h.*A 


C2  l(a+2)(a+l)  -  2(a+2)^ - ^ 

B 


'0  * 


(113) 


Parameters  o  and  b  are  completely  arbitrary  in  all  the  above  equations,  except 
that  a  >  -1  and  b  >  0,  and  are  the  available  cumulants. 


Observe  that  if  we 


let 


and 


a+1 


B 


'A.  A 

'h  ‘‘2*'0  ■"  **1 

_  a  - - -  a 

u^Uq  M 


(114) 
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then  C]L  =  0  and  C2  =  0  (here  we  also  used  (8)  and  (25));  this  is  a  special 
case  of  general  property  (33)  stated  earlier.  Since  the  probability  density 
function  p(u)  is  nonzero  only  for  u  >  0,  then  >  0  and  ^  >  0,  giving 
allowable  solutions  to  (114)  in  all  cases.  There  then  also  follows,  along 
with  dj^  *  d2  =  0  in  this  special  case,  the  explicit  results 


Cq  *  expOJj),  Cj  =0,  C2  »  0, 

^3  '  „  -„3  ^  ^1* 


Cil  = 


41  X, 


”  5;  xl  ^2  ^1  ■  ^5  ^0’ 


“  6:  X- 


*xl)0(-l  -  XjXilxl  *  * 

+  300;^  Cq, 


/ 

Cy  =  ^lOaOOTt^  +  12e07C^  xl  -  12600^  xl  Xi  -  1470)^  xl  X] 

+  ^2oo\xl  xl  +  To^xlxl  -  35:^  - 

-  62a-)l^x\  Xj  ♦  42?^  X^xl-Xj  Cg. 


(115) 
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These  relations  have  been  confirmed  by  numerical  comparison  with  (112). 

These  results  greatly  extend  those  of  [1,  (129)-(131)],  where  the 
equivalent  of  our  c^  is  given  (in  terms  of  moments  instead  of  cumulants,  and 
with  ^  =  0),  along  with  the  comment  that  “the  higher-order  coefficients  are 
so  complicated  that  the  whole  value  of  this  type  of  series  seems  to  depend  on 
the  fact  that  the  first  term  alone  (cq)  is  often  a  good  approximation."  We 
find,  on  the  other  hand,  that  not  only  can  we  avoid  the  special  choice  in 
(114)  and  the  corresponding  complicated  special  results  in  (115),  but  we  can 
handle  any  a,e  pair  and  get  very  high-order  coefficients  c^,  simply  by  using 
the  recurrence  in  (112),  which  is  easily  programmed.  The  only  thing  we  lose 
are  explicit  results  of  the  type  given  in  (115);  however,  the  latter  are  so 
complicated  that  they  are  of  limited  utility  anyway. 

COEFFICIENTS  DIRECTLY  VIA  MOMENTS 


(116) 


(117) 

It  is  useful,  in  this  generalized  Laguerre  series  case,  to  define  an 
alternative  set  of  normalized  moments 


We  will  need  the  following  expression  [5,  22.3.9]: 

nl  .(g),  ^  n!  ^  /nM  (-x)*^  M  (-x)*^ 

(o+l)„  ^  n  ^  ^  (a+lTj,  (n-k/  kl  (k/  (o+lj^  * 


Then  (92),  (90),  and  (3)  yield,  for  n  2 

■.  ■  wit; ■  wn;  { '■  '■'I’ft)  ■ 


1).  b' 
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"  («*!)„  s" 


for  n  >  0  . 


(Although  this  seems  to  be  very  different  from  the  earlier  normalization 
(69),  (118)  actually  reduces  to  (69)  for  the  a  here  equal  to  zero.)  When 
(118)  is  utilized  in  (117),  we  have  the  desired  expression  for  expansion 
coefficients  directly  in  terms  of  (normalized)  moments,  in  the 
surprisingly  simple  form 


>„  -  2  (J)  \  for  n  >0  . 


Parameters  a  and  g  in  (118)  are  arbitrary,  except  that  a  >  -1,  e  >  0. 


As  particular  cases,  (117)-(119)  yield 

=  “0-  »1  =  “0  -  •  >2  -  “0  -  • 

These  agree  with  (113)  which  utilized  cumulants.  If  we  make  the  special 
choices  of  a+1  =  -  nf)  and  e  =  (yg^Q  -  uf)/  UiVq), 

then  aj^  =  0  and  a2  =  0;  this  is  a  common  approach  to  the  approximation 
problem,  but  totally  unnecessary. 


An  alternative  derivation  of  the  direct  moment  relation  (117)  is 
possible:  from  (100),  (6),  and  [5,  15.1.8], 


(118) 

in 


(119) 


(120) 
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n  M  ^  1  /-W/&Y 

n  "  =  k!  'k  h^)  - 

2  ir»  T-ilT  d-wj-’-l-"  .  2.  ir»  ^ 
kS  i^"k  (.  b;  D;  in^"k  I  8/  5i 


n=0  "  k=0 

■  i'  “* 

=  2 

k=0  ■'•  *'  \  P'  k=0 

Equating  coefficients  of  we  have,  for  n  >  0, 


m^m 


(121) 


"n  = 


^  1.  r  lY  i!;2k  ^  /  nk  (n'\_^ 

^  k:  “k  I  pj  (n-k)j  *"  ni  ^  ^  U/  {^+ 


(a+l).  6* 


(122) 


which  is  equivalent  to  (117). 


COEFFICIENTS  RECURSIVELY  VIA  MOMENTS 


The  starting  point  for  this  case  is  the  characteristic  function  expansion 
in  (101): 

OO 

.  (-821^  = 
m 


f(2)  -  2  C„  (-6Z)'"  2  C„  (-BZ)"  2-^! - ^(BZ)"  (123) 


m=0 


m 


k=0 


by  use  of  [5,  15.1.8].  Now  expand  the  left-hand  side  of  (123)  in  powers  of  z, 
according  to  (6),  and  equate  the  coefficients  of  to  get,  for  n  ^  0, 


im 


1  m  (“■‘■^■*^)n_in  n_m  n  ^  C_(-l)  (a+l)„ 

1  '•c*  _  /  *\fn  n-fn  .n-m  .n  m  n 

jr“n=‘2s(-«)  TPiTi — ®  '*  ^ 

m«U  mstO 


(n-m)!  (a+l)|^  • 


(124) 


Therefore 


(a+1)^  m=0 


.sm  nl  S  fr\\ 


2  ^  »  (125) 
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by  use  of  (92).  Then  using  normalized  moment  definition  (118),  (125)  can  be 
expressed  as 

S  ^  (-!>'"  (m)  Si]  forr,>0  .  (126) 

This  is  a  recursive  relation  for  expansion  coefficients  [a^]  in  terms  of 
(normalized)  moments.  The  parameters  «  and  0  in  (118)  are  arbitrary,  except 
that  o  >  -1,  0  >  0. 

SUMMARY 


The  approximations  to  the  probability  density  function  and  cumulative 
distribution  function  are  given  by  (91)  and  (95),  respectively,  where  o  and  0 
are  arbitrary  constants,  except  that  o  >  -1,  0  >  0.  The  generalized  Laguerre 
polynomials  are  available  via  (96).  The  expansion  coefficients  [a^^]  are 
given  by  the  three  alternatives  (112),  (119),  (126),  in  terms  of  normalized 
cumulants  (62)  and  normalized  moments  (118);  in  the  case  of  (112),  the 
interrelationship  between  expansion  coefficients  Ja^  and  is  given  in 
(92).  Programs  for  all  three  alternative  procedures  for  determining  the 
expansion  coefficients  [a^*^  are  listed  in  an  appendix.  The  basis  for  these 
relations  is  the  characteristic  function  expansion  in  (100)-(102). 
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EXAMPLES  OF  HERMITE  EXPANSION 


EXAMPLE  A 

The  first  example  is  one  which  can  be  handled  analytically,  and  thereby 
furnishes  checks  on  numerical  procedures  and  results.  Consider  the  Gaussian 
probability  density  function 

(->0)  (12;a) 

with  cumulative  distribution  function  and  characteristic  function 

P(u)  “  5  “  exp  ^  •  (1278) 

The  cumulants  are 

^  *  0,  Xi  -  y*  7^  »  7C^  “  0  for  0^3,  (128A) 

while  the  moments  are  most  easily  evaluated  by  the  recurrence 

•'n  “  '‘n-1  *  '‘n-2  0^2,  Uq  »  1,  =«  t  •  (1288) 

It  is  obvious  in  this  Hermite  expansion  case  that  the  best  choice  of 
weighting  parameters  would  be  a  »  y,  a  »  u,  for  then  weighting  w  would  match  p 
perfectly  and  there  would  follow  =*  0  for  n  2  1*  consider  a  mismatched 
choice  of  o  and  a  to  illustrate  rapid  decay  of  the  expansion  coefficients  and 
some  conditions  on  convergence. 

Expansion  coefficient  c^  follows  from  (45)  and  (127A)  according  to 
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=  j"du  p(u)  “  ejdx  p{a+Bx)  He^(x) 


the  last  step  via  use  of  [5,  22.5.18]  and  [8,  7.374  10].  Then  from  (47), 


(129) 


bn  =  (n:)  for  n  >  0  . 


(130) 


This  equation  is  correct  for  all  positive  values  of  e  and  u.  However,  for 
a  <  «,  a  more  convenient  form  can  be  obtained  by  use  of  (74),  if  desired: 


-i/i  A[TJ\  /  \ 

vVoi  -0  / 


(131) 


where  Hi^  is  the  modified  Hermite  polynomial.  For  a  =  w,  a  limit  of  (130) 


yields  b^  =  (nl )"^^^( (y-o) /e)"^. 


If  a  >  u,  we  can  use  the  result  in  (50A)  on  (130)  and  obtain 


"  asn>+-. 


(132) 


Since  the  quantity  in  parentheses  is  always  less  than  1  in  this  case  of  a  >  w, 
we  have  b^^  »  o  as  n  >■ 


For  a  <  w,  we  use  [7,  theorem  8.22.7]  and  find  now  that 


bp  oC  exp(V2rr  A) 


i/2  «2 

tM  -a 


-‘A- 

n  as  n  > 


(133) 
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where  A  is  the  absolute  value  of  the  argument  of  He^^  in  (130).  This 
quantity  (133)  tends  to  zero  with  n,  regardless  of  A,  when  b  >  u/V?. 

Combining  with  the  result  above,  we  can  conclude  that 

b„  >•  0  as  n  >  +<o  for  7^<  a  <  (134) 

n  ^ 

Furthermore,  behaves  as  an  n~th  power,  which  is  faster  than 
thereby  guaranteeing  convergence  of  the  probability  density  function  and 
cumulative  distribution  function  series,  according  to  the  discussion  in  (50A) 
et  seq.  On  the  other  hand,  ^b^^  diverges  when  0  <  b  <  w/Y?,  as  may  be  seen 
from  (133). 

The  error  integral  in  (21)  is,  for  Hermite  weighting  (40)  and  probability 
density  function  (127), 

by  use  of  [8,  3.323  2];  this  integral  is  divergent  if  b  <  u/V?*  Thus,  for 
this  particular  example,  the  error  integral  and  expansion  coefficient 
sequence  ^b^^  converge  or  diverge  together,  depending  on  the  condition 
B  \  w/Y?.  The  choice  of  a  is  irrelevant  in  this  case. 

A  numerical  example  of  sequence  {b^^  for 

Y  =»  1.1,  u  =  2.3  o  =»  1.14,  B  “  2.34  (136) 
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is  plotted  in  figure  1  on  a  logarithmic  ordinate.  Values  of  less  than 
IE -7  in  absolute  value  are  all  plotted  at  the  *lE-7  line.  The  critical  ratio 

jI  P  pi 

|(B  -u)  /b  in  (130)  is  .184  for  this  example,  leading  to  rapid  decay  of 
expansion  coefficients  {b^^ .  The  three  sets  of  expansion  coefficients  in 
figure  1  are  labelled  according  to  the  shorthand  notation 

RC:  Recursively  via  Cumulants, 

DM:  Directly  via  Moments, 

RM;  Recursively  via  Moments.  (137) 

It  is  seen  that  the  expansion  coefficients  determined  recursively  via 
cumulants,  namely,  the  RC  plot,  decay  rapidly  and  never  encounter  round-off 
error,  whereas  the  DM  and  RM  procedures  both  are  subject  to  large  round-off 
error  for  n  >70,  as  indicated  by  the  large  increasing  oscillations.  This 
example  can  be  rather  misleading,  however,  since  all  the  cumulants  (128A)  of 
Gaussian  probability  density  function  (127A)  are  zero,  except  for 
^  ^  =  w  >  this  leads  to  a  very  special  form  of  the  RC  procedure 

unique  to  the  Gaussian  case. 

In  figure  2,  the  cumulative  distribution  function  and  exceedance 
distribution  function,  l-P(u),  as  determined  by  Hermite  expansion  (48)  using 
N  =  50  terms,  are  plotted.  The  exact  result,  (1278),  overlapped  these  curves 
over  the  full  range  plotted.  The  three  procedures,  RC,  DM,  and  RM,  all 
yielded  identical  distributions  in  figure  2,  as  inspection  of  figure  1 
confirms,  since  the  three  sets  of  expansion  coefficients  are  virtually  the 
same  for  n  <  50.  Even  though  the  three  sets  of  expansion  coefficients  differ 
significantly  for  n  >  60,  the  corresponding  approximate  probability  density 
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functions  and  cumulative  distribution  functions  for  N  -  70,  say,  would  not  be 
very  different,  because  the  relative  differences  in  p  and  P  are  very  small, 
somewhere  in  the  IE -5  range;  see  figure  1  for  n  =  70,  and  recall  that  bQ  =>  1 
for  this  example. 

EXAMPLE  B 


The  probability  density  function  of  interest  here  is  the  one  previously 
considered  in  (34)  et  seq.: 


p(u)  .  "  for  u  >  0  (y  >  -1,  U  >  0)  . 


(138) 


This  class  of  probability  density  functions  includes,  for  y  =  0,  1,  2, 
respectively,  the  one-sided  Gaussian,  Rayleigh,  and  Maxwell  as  special  cases. 
The  characteristic  function  and  cumulants  are  not  easily  determined  directly 
for  this  function.  However,  the  moments,  as  given  already  in  (35),  are 
readily  evaluated  via  the  simple  recursion 


2 

“n  “  ‘‘n-2  ^  (f-l+n)  for  n  >  2, 


(139) 


An  example  of  the  expansion  coefficients  for 


Y  »  3,  («j  =  1 


a  =  0,  8  =  .7 


(140) 


is  depicted  in  figure  3.  The  values  of  b^,  for  n  »  0,  1,  2,  3  are  1,  1.90, 
2.18,  1.63,  respectively,  and  lie  above  the  top  of  the  plotted  region.  The 
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coefficients  obtained  directly  via  moments,  DM,  decay  to  approximately  lE-4 
near  n  =  70  and  then  encounter  round-off  error.  The  expansion  coefficients 
corresponding  to  RC  and  RM  are  more  noisy.  The  procedure  used  for  RC  was  to 
determine  the  moments  via  (139),  transform  directly  to  cumulants  according  to 
{A-7),  and  then  use  (63). 

A  plot  of  the  distributions  using  N  =  65  terras  is  given  in  figure  4;  the 
results  are  the  same  for  all  three  sets  of  expansion  coefficients,  as  may  be 
seen  by  reference  to  figure  3.  Furthermore,  the  exact  cumulative  distribution 
function,  P(u)  =  1  -  (1+u  )  exp(-u  )  for  u  >  0,  overlays  these  results 
except  for  the  bow  in  the  exceedance  distribution  function  below  lE-11  near 
u  =  5.5.  Values  of  the  cumulative  distribution  function  for  u  <  0  as 
determined  by  series  (48)  are  not  zero,  although  they  should  be  for  this 
example;  the  generalized  Laguerre  series  would  fit  this  example  better,  since 
it  is  nonzero  only  for  positive  arguments. 

EXAMPLE  C 


Consider  the  class  of  Bessel-function  probability  density  functions 

p(u)  =Au''^  exp(-u^/«^)  I^(eu)  for  u  >  0  ,  (141) 

which  includes  the  Rice  and  generalized  distributions,  for  example.  The 
n-th  moment  is  [8,  6.631  1] 


n+2h 

e  1  \2 

2^1  f 

for  n  >  0  , 


(142) 
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with  h  =  (y+J+1) /2;  in  order  for  ng  to  be  finite,  we  must  have  h  >  0.  The 
function  in  (142)  can  be  evaluated  via  recursion;  this  leads  to  a 
recursion  for  the  moments  (see  appendix  E). 


We  consider  here  only  the  special  case  of  the  Rice  probability  density 
function,  namely, 

exp  ^  ^  ,  Y  =  1.  j’=  0  ,  (143) 

for  which 

/  2  2  2\ 

p(u)  =  ^  expf-  ^  -  ■^!^-|-jlg(eu)  for  u  >  0  .  (144) 

U  \  ti)  / 

The  moments  in  (142)  then  reduce  to 

^n  ~  1^1  f  1 

and  can  be  easily  determined  by  the  recurrence  presented  in  (E-5).  The 
cumulative  distribution  function  corresponding  to  (144)  is  the  Q  function  [1] 


P(u)  =  1 


for  u  >  0  ; 


(146) 


the  characteristic  function  is  given  in  [9,  appendix  A]  as  an  infinite  series, 
meaning  that  the  cumulants  cannot  be  determined  directly,  except  via  the 
moments. 


The  particular  example  we  consider  here  for  the  Hermite  expansion  is  a 
sum  of  8  independent  random  variables,  each  with  Rice  probability  density 
function  (144).  For  direct  comparison  with  the  exact  results  in  [9],  we  also 
consider  the  normalized  form  of  (144),  namely  =  2.  Furthermore,  we  limit 
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numerical  consideration  in  this  pa’^ticular  example  to  evaluation  of  the 
cumulative  and  exceedance  distribution  functions  for  e  =  0,  which  corresponds 
physically  to  the  false  alarm  probability  for  the  sum  of  eight  normalized 
envelopes  of  narrowband  Gaussian  noise  (i.e.,  a  Rayleigh  probability  density 
function  for  the  individual  random  variables). 

For  a  =  4,  3  =  2.15,  the  expansion  coefficients  [b^  are  displayed  in 

figure  5  for  the  RC,  DM,  and  RM  approaches.  All  the  {b^]  for  1  £  n  _<  20  are 

bigger  than  1;  the  biggest  is  bg  =  12.25.  The  {b^] ,  for  both  moment 
approaches,  have  not  been  plotted  for  n  >  60  because  they  continue  to 
oscillate  well  beyond  the  *1  limits,  while  the  RC  coefficients  decay 
exponentially  with  n.  Despite  the  fact  that  the  moments  were  the  initially 
determined  qu?*^tities  for  this  example,  the  RC  method  far  outperforms  the  DM 
and  RM  methods,  as  seen  in  figure  5.  The  reason  for  this  is  as  follows:  for 
the  RC  method,  the  procedure  was  to  obtain  moments  via  (145),  cumulants  via 
(A-7),  cumulants  of  the  sum  of  8  independent  random  variables  by  simple 

scaling  by  a  factor  of  8,  and  then  expansion  coefficients  via  (63).  For  the 

DM  and  RM  methods,  the  moments  of  the  sum  of  8  random  variables  were 
determined  via  [6,  (14)]  which  progressively  determined  the  moments  of  a  sum 
of  2  random  variables,  then  3,  4,...,  8  in  order,  and  then  employed  (70). 

This  iterated  procedure  for  moments  requires  more  number-crunching  and  leads 
to  considerably  larger  round-off  error  than  the  simple  scaling  required  for 
the  RC  procedure.  Thus  it  appears  that  when  the  random  variable  of  interest 
is  obtained  as  a  sum  of  several  independent  random  variables,  the  RC  approach 
will  be  the  prime  candidate  for  expansion  coefficient  evaluation;  this  applies 
also  if  the  individual  random  variables  have  different  statistics,  but  remain 
independent. 
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The  cumulative  and  exceedance  distribution  functions  for  this  sum  of  8 
normalized  Rayleigh  variates  are  plotted  in  figure  6,  for  the  N  =  140 
expansion  coefficients  of  the  RC  procedure  in  figure  5.  In  order  to  make  a 
precise  determination  of  the  accuracy  of  this  Hermite  series  approach,  the 
false  alarm  probabilities  were  computed  at  the  eight  thresholds  listed  under 
M  =  8  in  [9,  table  1].  To  the  precision  given  in  that  table,  the  computed 
probabilities  were  exactly  the  specified  values  lE-m  for  m  *  1(1)8.  Thus,  as 
anticipated  by  figure  5,  very  accurate  evaluation  of  false  alarm  probabilities 
are  possible  by  this  series  approach. 

A  short  search  of  values  of  the  best  weighting  parameters  a  and  b,  to  use 
with  the  DM  approach,  led  to  a  =  5.84,  b  =  2.28  and  expansion  coefficients 
bj^  near  lE-4  at  n  =  28,  before  round-off  error  became  dominant.  This  is 
better  than  the  result  of  DM  in  figure  5  for  a  =  4,  b  =  2.15.  Evaluation  of 
the  false  alarm  probabilities  at  the  thresholds  in  [9,  table  1]  gave  7  decimal 
accuracy  at  .1,  and  4  decimal  accuracy  at  lE-8.  This  is  adequate  for  most 
purposes,  but  is  not  as  good  as  the  RC  approach. 

EX/WPLE  D 


In  [4,  appendix  C],  the  characteristic  function  for  shot  noise  with 
random  ampi itude. and  duration  modulation,  and  arbitrary  individual  pulse 
shape,  is  derived.  (This  result  is  then  specialized  to  elliptical  pulses  and 
Rayleigh  amplitude  modulation  [4,  (C-36)-(C-42)]. )  Also,  the  cumulants  are 
extracted,  with  general  result  [4,  (24)],  where  v  is  the  average  number  of 
pulses/second,  X.  is  the  average  length  of  the  duration  modulation,  Ug(n)  is 
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the  n-th  moment  of  the  amplitude  modulation,  and  F(x)  is  the  individual  pulse 
shape  of  the  shot  noise.  Thus  shot  noise  is  a  case  where  the  cumulants  are 
directly  capable  of  evaluation,  whereas  the  moments  must  be  found  indirectly. 

For  the  special  case  of  elliptical  pulses  and  Rayleigh  amplitude 
modulation,  there  follows  for  the  cumulants  [4,  (29)]: 

^n  “  “"a  ^  P^(7'*‘^/r(n+2)  for  n  >  1,  ^  «  0  .  (147) 

These  quantities  are  easily  evaluated  via  recurrence 

^  “  ^n-2  n^/(n+l)  for  n  ^  3*  ^  ‘^a*  ^  §  ''^®a  * 

This  procedure  was  used  in  [4,  appendix  D]  to  obtain  the  probability  density 
function  and  cumulative  distribution  function  results  given  there. 

There  is  a  nuance  that  arises  in  shot  noise  for  pulse  shapes  of  finite 
duration;  see  [4,  pp.  40-42].  Namely,  there  is  an  impulse  in  the  probability 
density  function,  at  u  =  0,  of  area 

Pq  =  exp[-vl(x2  -  Xj)]  ,  (149) 

where  (X2^,X2)  is  the  non-zero  extent  of  an  unmodulated  individual  pulse. 

Since  an  impulse  is  very  difficult  to  approximate  by  a  finite  series  of 
continuous  functions,  the  effect  of  this  quantity  should  be  subtracted  from 
the  statistics  (moments  or  cumulants),  and  the  continuous  portion  of  the 
probability  density  function  should  be  approximated.  Similarly,  the 
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corresponding  step  in  the  cumulative  distribution  function  at  the  origin 
should  be  eliminated  from  the  approximation  procedure. 

This  feature  is  easily  incorporated  if  Pq  is  subtracted  from  the 
zero-th  order  mcMnent  [4,  p.  42],  The  only  undesireable  side-effect  of  this 
manipulation  is  that  the  initially  computed  cumulants  must  be  transformed  to 
moments,  then  corrected,  and  then  all  the  new  cumulants  evaluated.  This 
double  transformation  is  necessary  because  the  correction  (subtraction) 
procedure  can  only  be  accomplished  in  the  moment  domain.  Of  course,  when  the 
DM  or  rai  procedures  are  employed  instead  of  RC,  the  last  transformation  to 
cumulants  is  unnecessary;  this  was,  in  fact,  the  procedure  used  in  [4,  p.  60]. 

When  the  individual  pulse  F{x)  has  infinite  duration,  as  for  an 
exponential  or  Gaussian  waveform,  then  X2  -  x^  is  infinite  and  Pq  in 
(149)  is  zero.  In  that  case,  the  considerations  in  the  last  two  paragraphs 
can  be  disregarded,  and  the  cumulants  generated  via  (148)  used  as  is.  It  is 
then  very  likely  that  even  better  accuracy  in  the  expansion  coefficients  will 
be  achieved  than  for  this  current  example. 

For  overlap  factor  [4,  p.  43] 

iq  =  vj(x2  -  Xj)  =  6.2,  Pq  =  exp(-6.2)  =  .00203,  *  (150) 

and  for  weighting  parameters  a  =  6.1,  e  =  4.3,  the  expansion  coefficients 
are  displayed  in  figure  7  for  the  three  recursive  procedures.  The  RM 
results  are  considerably  poorer  than  the  RC  and  DM  coefficients,  which  are 
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comparable  for  n  <  65.  However,  even  here,  the  coefficients  have  only  decayed 
to  the  lE-3  level,  which  may  not  be  sufficiently  small  for  accurate  results. 

The  distributions  using  N  =  65  terms  and  the  RC  expansion  coefficients 
are  given  in  figure  8.  Although  the  actual  cumulative  distribution  function 
is  zero  for  u  <  0,  the  approximation  oscillated  around  zero,  reaching  a 
positive  peak  of  value  .22E-3  at  u  =  -2.  Similarly,  significant  wiggles 
develop  in  the  exceedance  distribution  function  below  the  lE-4  level.  The 
reason  for  the  inadequacy  of  these  Hermite  expansions  near  u  =  0  is  the  abrupt 
zero  behavior  of  the  true  probability  density  function  for  negative  arguments, 
a  feature  inherently  difficult  to  approximate  by  means  of  smooth  continuous 
functions.  The  error  of  the  approximations  in  figure  8  is  estimated  in  a 
later  section  and  superposed  on  the  plot,  for  ease  of  ascertaining  the 
reliability  of  the  curves.  The  corresponding  approximations  for  the 
generalized  Laguerre  series  are  better  for  this  type  of  probability  density 
function,  as  will  be  demonstrated  in  the  next  section. 

The  approximate  probability  density  function  for  this  example,  again  with 
N  =  65  terms,  is. given  in  figure  9  on  a  linear  ordinate.  It  reaches  a 
negative  peak  of  -8E-4,  and  crosses  the  u  =0  axis  with  value  .004;  both  of 
these  values  should  be  zero,  and  will  be  for  the  generalized  Laguerre  series. 

To  see  how  the  approximate  probability  density  function  behaves  for  larger 
arguments,  the  logarithmic  plot  in  figure  10  is  used,  k^liggles  develop  near 
the  lE-4  level  and  become  large  enough  that  negative  values  of  the  density  are 
yielded  near  u  =  28  and  31.  It  will  be  worthwhile  to  compare  this  Hermite 
series  with  the  generalized  Laguerre  series  to  be  presented  in  the  next 
section.  The  estimated  error  associated  with  figure  10  is  developed  in  a 
later  section. 
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u,  threshold 

Figure  9.  Linear  Density  for  Example  D 


Figure  10.  Log  Density  for  Fxampl 
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EX/WPLES  OF  GENERALIZED  LAGUERRE  EXPANSION 

EXAMPLE  E 

As  with  the  earlier  Hermite  expansions,  the  first  generalized  Laguerre 
example  here  is  one  that  can  be  evaluated  analytically,  for  purposes  of 
checking  numerical  procedures  and  results.  Namely  consider  the  Chi-square 
probability  density  function  of  2(y‘‘‘1)  degrees  of  freedom  (which  need  not  be 
integer) : 

p(„)  ,  uLexElzuM  (,  >.1,  „>o).  (151) 

^  r{Y*i) 

All  probability  density  functions  and  approximations  are  limited  to  u  >  0  in 
this  section,  since  they  are  zero  for  u  <  0;  this  restriction  will  be  presumed 
in  the  remainder  of  the  presentation. 

The  exceedance  distribution  function  is  related  to  the  incomplete  Gamma 


function  [5,  6.5.3]: 

01 

1  -  P(u)  =  f  dt  p(t)  =  n-r+l,  u/»)/  r(Y+l)  .  (152) 

u 

The  characteristic  function  follows  from  (151)  as 

f(i5)  =  (1  -  ifa,)"^-^  ,  (153) 

with  cumulants 

\  =  (k-l)J  (y+1)  /  for  k  >  1,  =  0  ,  (154) 

and  moments 

=  (y+1),^  0.'^  for  k  >  0  .  (155) 
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Thus  either  set  of  statistics  can  be  used  as  a  starting  position.  The  error 
integral  in  (21)  is  finite  if 

-1  <  a  <  2y  +  1  and  a  >  w/2  .  (156) 

We  will  find  the  expansion  coefficients  by  means  of  the  characteristic 
function  expansion  (100),  developed  earlier  for  the  generalized  Laguerre 
series.  Specifically,  we  utilize  the  power  series  expansion 


where  we  used  (153)  and  [5,  15.1.8]  twice.  The  coefficient  of  a  general  term 
w*^  is  then  immediately  given  by  the  closed  form 


Alternative  expressions  for  the  expansion  coefficients  are 


(158) 


(159) 


obtained  by  means  of  [5,  15.1.1,  15.3.5,  15.3.7]  respectively.  In  fact,  the 
last  result  can  be  obtained  directly  by  using  [8,  7.414  7]  on  (90)  and  (151): 
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c 


n 


oO 


0 


exp(-u/a))  ,  (a) 


(160) 


However,  the  latter  two  results  in  (159)  are  not  numerically  stable,  whereas 
(158)  and  the  first  line  of  (159)  are  stable  for  large  n,  without  encountering 
round-off  error. 


Some  special  cases  of  (158)  are  as  follows: 

(y+Dn 

if  then  c„  -  J  (Y)  : 

(o-Y)n 

if  B  =  o»,  then  c^  =  — ppr —  ; 


if  a  =  Y  and  B  =  u),  then  c^  =  .  (161) 

The  last  case  is  to  be  expected,  since  the  weighting  exactly  matches  the 
probability  density  function  (151)  then. 


A  numerical  example  of  sequence  (b^"^  for 

Y  =  1.1,  u  =  2.3  a  =1.105,  B  =  2.1  (162) 

is  shown  in  figure  11,  using  the  three  recursive  procedures  developed  earlier 
for  the  generalized  Laguerre  series  in  (112),  (119),  (126).  In  addition, 
exact  result  (158)  is  plotted  for  comparison.  The  expansion  coefficients  have 
a  rapidly  decaying  transient  for  n  <  10,  and  then  a  decay  approximately 
proportional  to  for  large  n.  The  abrupt  change  of  character  at  n  »  5 

does  not  signify  the  onset  of  round-off  error;  rather,  the  latter  is  indicated 
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n,  sequence  number 

Figure  11.  Generalized  Laguerre;  Example  E 


Figure  12.  Di str i but i ons  for  Example  E 
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by  an  erratic  behavior,  typically  increasing  exponentially  with  n  (linear 
growth  on  a  logarithmic  ordinate). 

A  different  plotting  strategy  will  be  adopted  henceforth  for  the 
expansion  coefficients  {b^},  in  order  not  to  clutter  the  diagrams  with  large 
oscillations  as  in  figures  1,  3,  5,  7.  Specifically,  when  the  expansion 
coefficient  b^^  first  exceeds  the  *1  limits,  the  remainder  of  sequence  {b^} 
will  not  be  plotted,  since  this  is  a  region  of  large  round-off  error.  Thus, 
although  the  RM  curve  in  figure  11  returns  to  the  *1  limits  briefly  at 
n  »  52,53,  these  values  are  not  displayed. 

Round-off  error  for  the  RC  procedure  does  not  become  as  significant  as 
for  the  two  moment  approaches  until  n  has  increased  by  almost  10,  for  this 
example  in  figure  11.  In  fact,  the  expansion  coefficients  for  the  RC 
procedure  overlap  the  exact  values  until  n  *  40.  The  corresponding 
approximate  distributions,  using  N  =  40  terms  in  expansion  (95)  as  determined 
by  RC,  are  plotted  in  figure  12.  The  exact  result  (152)  overlays  these 
results  over  the  entire  range  plotted. 

EXAMPLE  F 


The  following  probability  density  function  corresponds  to  a  noncentral 
Chi-square  variate  of  2v  degrees  of  freedom; 

p(u)  ^  Iv-iltlW  (»  >  0)  ;  (163) 
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d  is  the  noncentrality  parameter,  and  2v  need  not  be  integer.  The 
characteristic  function  is  [8,  6.631  4] 

f(1f)  =  (l-iZ?)'"  .  (164) 

and  is  the  same  as  the  one  considered  in  [10,  (50)  et  seq.].  The  exceedance 
distribution  function  is  the  generalized  Q-function: 

1  -  P(u)  =  j^dt  I  exp  (-  (dyf)  = 

*  dx  X  exp  (-  j  [g-]  •  (165) 

By  expanding  the  i^n  of  (164)  in  a  power  series  in  i?,  the  cumulants 
follow  as 

=  2"(n-l)l  +  I  d^  n^  for  n  >  1,  =  0  •  (166) 

And  the  moments  are  obtained  from  (163)  as 

“n  ■  iPi(-'';'>;-<‘^/2)  - 

=  2"  n:  (-d^/2)  for  n  >  0  ,  (167) 

by  use  of  [8,  6.631  1]  and  [5,  13.6.9].  Both  (166)  and  (167)  lend  themselves 
to  simple  recurrences  which  involve  only  positive  quantities;  thus  the 
starting  statistics  can  be  quickly  and  accurately  evaluated. 

The  numerical  example  we  consider  here  will  be  compared  with  the  exact 
results  in  [10,  figure  11],  namely. 
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V  =  2.7,  d  =  3  a  =  1.7,  6  *  5.5  .  (168) 

Since  the  probability  density  function  in  (163)  behaves  as  u''~^  as  u  >  0+, 
it  is  reasonable  to  choose  weighting  parameter  a  in  (82)  as  v-1,  as  indicated 
in  (168).  And  since  (163)  behaves  as  exp(-u/2)  as  u  >  we  must  choose 
S  >  1  in  order  that  the  error  integral  in  (21)  is  finite.  The  particular 
values  in  (168)  approximately  minimize  the  sum  of  {b^lg  in  (21). 

The  expansion  coefficients  {b^}  as  determined  by  the  three  available 
recursive  procedures  are  displayed  in  figure  13.  The  RC  coefficients  decrease 
to  values  less  than  lE-10  near  n  =  50,  before  round-off  error  becomes 
significant.  The  two  moment  approaches  deteriorate  near  n  =  30,  which  is 
markedly  poorer  than  the  cumulant  approach.  The  distributions,  as  determined 
by  N  =  50  terms  of  the  RC  approach,  are  given  in  figure  14,  and  agree  with  the 
d  =  3  curve  of  [10,  figure  11].  When  the  approximate  probability  density 
function  for  N  =  50  was  compared  with  exact  result  (163),  10  decimals  of 
agreement  were  obtained;  this  is  due  to  the  ability  to  get  very  small  ^b^| 
in  figure  13  via  the  RC  method. 


EXAMPLE  6 

This  example  is  the  Rice  probability  density  function  given  in  (144), 
with  moments  (145)  and  cumulative  distribution  function  (146).  The  starting 
statistics  are  the  moments  as  determined  by  recurrence  (E-5)-(E-6). 
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The  particular  numerical  case  of  interest  is 

»  =  3,  (o2  =  2  0=1,  0=1.  (169) 

The  values  of  o  and  a  were  found  by  the  usual  trial  and  error  search  procedure 
of  observing  plots  of  expansion  coefficients  {b^'J,  looking  for  rapid  decay 
and  small  round-off  error;  results  for  this  example  are  displayed  in  figure 
15.  The  RM  procedure  deteriorates  rapidly  at  n  =  30,  whereas  DM  and  RC  are 
useable  up  to  n  =  55  and  65  approximately. 


The  cumulative  and  exceedance  distribution  functions  for  N  =  65  terms  of 
the  RC  procedure  are  plotted  in  figure  16,  along  with  exact  result  (146).  The 
approximate  exceedance  distribution  function  overlaps  the  exact  one  until 
slightly  below  the  probability  level  lE-4,  which  corresponds  to  the  level  of 
reliability  of  b^  in  figure  15  at  n  =  65.  Then  the  exceedance  distribution 
function  makes  a  positive  (upward)  turn  below  IE -6,  which  is  impossible  for  a 
physical  density  function  which  must  remain  positive;  thus  the  approximation 
deteriorates  rapidly  for  u  >  7. 

EXAMPLE  H 

This  is  a  follcw-on  to  the  previous  example,  in  that  we  consider  a  sum  of 
8  Rice  variates,  each  with  the  statistics  in  (169).  The  exoansion 
coefficients  for 

e  =  3,  0)2  =  2  a  =  26,  0=1  (170) 
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Figure  15.  Generalized  Laguerre;  Example  G 
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Figure  16.  Distributions  for  Example  G 
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are  displayed  in  figure  17.  Whereas  both  DM  and  are  useless  beyond  n  «  25, 
the  expansion  coefficients  determined  by  RC  decay  down  to  the  IE -10  level  at 
n  sf  150  before  round-off  error  becomes  significant.  The  corresponding 
distributions  in  figure  18,  using  N  =  143  terms  of  the  expansion  via  RC, 
reveal  accurate  results  down  to  the  lE-12  level  of  probability,  except  for  a 
slight  flare  in  the  exceedance  distribution  function  below  lE-11. 

We  also  checked  the  example  of  the  sum  of  8  normalized  Rayleigh  variates 
considered  earlier  via  a  Hermite  series  in  example  C.  For  a  =  10,  e  =  .9,  the 
expansion  coefficients  {bj  decayed  to  the  lE-11  level  at  n  =  100  for  the  RC 
approach  and  agreed  with  the  false  alarm  probabilities  calculated  exactly  in 
[9,  table  1]  for  M  =  8.  By  contrast,  the  DM  expansion  coefficients  were 
subject  to  significant  round-off  error  by  the  time  n  reached  30,  and  were 
useless  for  small  probability  calculations. 

EXAMPLE  I 

We  return  to  the  shot  noise  process  previously  considered  via  a  Hermite 
series  in  example  D.  The  equations  and  discussions  there  should  be  reviewed, 
since  they  are  directly  relevant  to  the  generalized  Laguerre  expansion  here. 

For  the  choice  of  parameters  in  (150),  the  selection  of  generalized  Laguerre 
weighting  parameters 

a  =  .74,  B  =  2.1  (171) 

leads  to  the  expansion  coefficients  plotted  in  figure  19.  The  DM  and  RC 
results  agree  to  n  =  32,  and  then  begin  to  diverge  from  each  other.  By  way  of 
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Figure  19.  Generalized  Laguerre;  Example  I 
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contrast  with  the  Hermite  expansion  coefficients  in  figure  7,  where  values  in 
the  lE-3  range  were  achieved,  values  in  the  lE-6  range  can  be  obtained  here 
for  the  generalized  Laguerre  expansion,  for  n  in  the  inid-30s.  The  DM  result 
was  previously  given  in  [4,  figure  D-1]. 

The  distributions  for  N  =  32  terms  of  the  RC  procedure  are  plotted  in 
figure  20.  This  result  is  considerably  better  than  the  Hermite  expansion  in 
figure  8;  instead  of  the  wiggles  which  developed  at  lE-4  in  figure  8,  the 
curve  in  figure  20  is  smooth  down  to  the  IE -8  probability  level,  and  then 
develops  a  bump.  Also,  the  cumulative  distribution  function  is  accurate  at 
u  =  0,  where  it  takes  on  the  value  Pq  =  .002  given  in  (150),  and  is  zero  for 
u  <  0.  This  cumulative  distribution  function  was  previously  given  in 
[4,  figure  8]. 

The  probability  density  function  for  N  =  32  terms  of  the  RC  procedure  is 
given  in  figure  21;  this  result  was  previously  given  in  [4,  figure  9].  It  is 
significantly  better  near  the  origin  than  the  Hermite  approximation  given 
earlier  in  figure  9,  which  developed  negative  values  for  u  <  0.  In  order  to 
see  what  the  probability  density  function  does  for  larger  u  values,  the  same 
probability  density  function  is  plotted  on  a  logarithmic  ordinate  in  figure 
22.  It  is  accurate  to  the  lE-9  leve  but  then  develops  a  hook  that  is 
incorrect;  however,  this  approximation  remains  positive  even  at  this  very  low 
value  of  the  density,  whereas  the  corresponding  result  via  a  Hermite  expansion 
in  figure  10  developed  negative  values.  The  estimated  errors  in  figures  20 
and  22  are  evaluated  in  a  later  section. 
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This  last  exairqile  Is  for  probability  density  function 

p(u)  S'!  exp^^)  for  u  >  0  ,  (172) 

for  which  the  moments  are 

Un  =  (2n+l):  .  (173) 

The  characteristic  function  and  cumulants  are  not  available  in  any  convenient 
analytic  form. 

This  is  a  particularly  difficult  example,  since  the  characteristic 
function  expansion  in  (6)  has  a  zero  radius  of  convergence;  thus  the  moments 
do  not  uniquely  determine  the  probability  density  function  or  cumulative 
distribution  function.  Also,  the  error  integral  in  (21)  is  always  infinite; 
in  fact,  regardless  of  the  choice  of  weighting  parameters  a  and  a  used  in  the 
generalized  Laguerre  series,  the  expansion  coefficients  ^b^^  always 
diverged.  Nevertheless,  a  search  of  parameter  values  led  to  a  pair  of 
selections,  namely, 

o  =  -.35,  a  =  30,  (174) 

for  which  the  expansion  coefficients  had  an  initial  decay  to  the  lE-2  level 
before  divergence  took  over;  see  figure  23.  In  fact,  the  identical  same 
results  were  obtained  for  all  three  methods,  RC,  DM,  RM;  this  is  probably  due 
to  the  fact  that  divergence  of  ^b^^  dominated  before  round-off  error  became 
significant. 
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Figure  23.  Generalized  Laguerre;  Example  J 


Figure  24.  Distributions  for  Example  J 
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The  distributions  are  plotted  in  figure  24  for  N  =»  15  tenns  of  the 
generalized  Laguerre  series.  Comparison  with  the  exact  exceedance 
distribution  function 

1  -  P{u)  =  (1  +  u^^^)  exp  (-u^^^)  for  u  >  0  (175) 

reveals  that  the  approximation  is  decent  down  to  the  .01  probability  level, 
but  then  oscillates  more  and  more  violently  as  u  increases.  Thus  even  in  this 
non-unique  example,  a  limited-quality  approximation  is  achieved  by  the 
generalized  Laguerre  series;  this  example  confirms  the  comment  in  [3,  p.  167] 
that,  even  for  a  divergent  series,  a  limited  number  of  expansion  coefficients 
often  gives  a  satisfactory  approximation. 

The  exact  and  approximate  probability  density  functions  are  plotted  on  a 
linear  ordinate  in  figure  25,  and  on  a  logarithmic  ordinate  in  figure  26, 
using  N  =  15  terms  of  the  generalized  Laguerre  series,  when  the  expansion 
coefficients  were  determined  by  the  DM  method.  The  approximate  probability 
density  function  is  negative  for  150  <  u  <  190,  around  the  IE -6  level.  The 
estimated  errors  of  the  approximations  in  figures  24  and  26  will  be  developed 
in  the  next  section. 
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Figure  25.  Linear  Density  for  Example  J 


Figure  26,  Log  Density  for  Example  J 
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ESTIMATED  ERRORS  OF  APPROXIMATIONS 

li^en  the  calculations  of  the  approximate  cumulative  or  exceedance 
distribution  functions  or  the  corresponding  probability  density  function  are 
made,  it  would  be  very  useful  to  have  a  rough  estimate  of  their  reliability. 
One  way,  as  discussed  in  the  previous  sections,  is  to  look  for  nonsmooth  or 
anomalous  behavior  on  the  tails  of  the  functions.  Here,  we  will  develop  a 
more  quantitative  estimate  of  the  error  and  superpose  it  on  some  of  the 
previous  examples,  for  confirmation. 

Both  the  Hermite  and  generalized  Laguerre  orthonormal  polynomials 
oscillate  with  n  and  decay  slowly.  The  same  general  behavior  is  true  of 
expansion  coefficients  This  leads  to  summations  for  the  various 

functions  with  terms  that  also  oscillate  and  decay.  A  rough  estimate  of  the 
error  is  afforded  by  the  envelope  of  these  oscillations,  evaluated  at  the 
first  neglected  term  of  the  summation.  This  procedure  will  be  pursued  for 
both  types  of  expansions;  how  useful  it  is  will  be  indicated  by  numerical 
examples. 

HERMITE  EXPANSION 

The  following  result  for  the  envelope  of  the  Hermite  polynomial  is 
obtained  from  [5,  6.1.39  ..nd  22.5.18]  and  [7,  8.22.8]: 

Env|(nO  He^(x)j  ~  exp(x^/4)  as  n  ►  (176) 

Also,  from  (46)  and  (47),  the  n-th  term  of  the  approximate  probability  density 
function  is 
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*  (¥)  “n  ("0"'^  • 


Then  the  magnitude  of  the  error  of  the  probability  density  function 
approximation,  if  the  n-th  term  is  the  first  one  neglected,  is  roughly 

E„  (  SP)  ^  -f  4  (V)  Env?b„]  Env  {(n:)"'*'  = 

-  [2  ,'^9]"  exp  /-  Env[b„]  as  n  » 

Here  we  used  (176). 


(177) 


(178) 


As  for  the  cumulative  distribution  function,  we  have  from  (47)-(49),  the 
n~th  term  of  the  approximation  as 


The  magnitude  of  the  error  for  the  cumulative  and  exceedance  distribution 
function^  if  the  n-th  term  is  the  first  one  neglected,  is  then  defined  as 

■  *  M  K)  =  '^n-1  Ml  - 

Again.  (176)  was  of  crucial  importance  in  getting  this  result. 


(179) 


(180) 
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Since  the  above  estimates  are  asymptotic  in  n,  they  will  be  most  reliable 
for  n  large;  their  use  for  small  n  could  be  very  misleading.  The  way  to  use 
these  error  estimates  for  the  density  and  distribution  approximations  is  as 
follows.  First,  a  search  on  a  and  6,  to  find  the  fastest  decaying  expansion 
coefficients  is  conducted.  The  weighting  parameter  values,  a  and  b, 

and  the  corresponding  envelope  value  of  the  expansion  coefficients  {b^}  at 
the  point,  n,  where  round-off  error  becomes  dominant,  are  then  noted.  (For 
example,  for  figure  7,  we  observe  that  Envjb^  s?  2E-3  at  n  =  65,  when 
o  =  6.1,  3  =  4.3;  see  example  D.)  Then  (178)  and  (180)  can  be  computed  and 
plotted  in  the  ranges  of  u  of  interest. 

An  example  of  this  procedure  for  the  shot  noise  process  in  example  D  is 
given  in  figures  27  and  28.  In  particular,  the  approximate  results  are 
repeated  from  figures  8  and  10,  and  error  measures  (180)  and  (178), 
respectively,  are  superposed  as  dashed  lines,  each  on  the  appropriate  figure. 
Just  where  the  approximations  develop  large  wiggles,  the  errors  are  of 
comparable  magnitude,  indicating  unreliable  estimates  there. 

It  should  be  observed  from  these  figures  (or  from  (178)  and  (180))  that 
the  absolute  error  is  maximum  at  u  =  o,  but  that  the  relative  error  is  a 
minimum  in  that  neighborhood.  Also,  although  the  absolute  error  decays  with 
u,  the  correct  answer  decays  faster,  leading  to  an  increasing  relative  error, 
which  eventually  becomes  so  excessive  in  the  tails  of  the  various  functions 
that  the  approximations  are  useless. 
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GENERALIZED  LAGUERRE  EXPANSION 


The  details  for  the  generalized  Laguerre  series  are  very  similar  to  those 
above  and  so  will  be  abbreviated.  The  envelope  of  the  generalized  Laguerre 
polynomial  is  [7,  8.22.1] 

Env|L^“^(x)j  ~  ir  ^  e^  X  ^  n^  ^  as  n  >■  for  x  >  0  .  (181) 

From  (91)  and  (92),  the  n-th  term  of  the  approximate  probability  density 


function  is 


u“  exp(-u;6)  /  nj 

Then  the  magnitude  of  the  error  of  the  probability  density  function 
approximation  is,  for  u  >  0, 

E„v[(^y\W  (.)]  = 


(182) 


rr(a+l)B 


~\/l  a  1 

n'  /.a"? ‘I 


'1  (s)  2?)  "  ^ 


(183) 


where  we  used  [5,  6.1.47]  and  (181).  This  quantity  peaks  at  u  =  0(a-y). 


With  regards  to  the  cumulative  distribution  function,  the  n-th  term  of 
the  approximation  is,  from  (95)  and  (92), 
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exp(-u/g} 

"g^^^Tun) 


(184) 


Then  the  magnitude  of  the  distribution  error,  for  both  the  cumulative  and  the 
exceedance  distribution  functions,  is  roughly 


E 


n 


(u;P)s 


_+l 

u  exp(-u/g) 

8“*^  r(.n) 


“  +  1 


exp 


>  0. 


(185) 


upon  use  of  (181).  This  quantity  reaches  its  peak  at  u  =  g(a+i). 


An  application  of  these  results  to  the  shot  noise  process,  which  was 
re-investigated  in  example  I  via  the  generalized  Laguerre  series,  is  given  in 
figures  29  and  30.  Specifically,  the  approximate  results  from  figures  20  and 
22  have  been  repeated,  and  error  measures  (185)  and  (183),  respectively, 
superposed  as  dashed  lines.  They  confirm  the  earlier  observations  that  the 
distribution  and  density  approximations  are  reliable  until  the  anomalous 
behavior  on  the  tails  manifests  itself. 


The  difficult  example  J  is  considered  in  figures  31  and  32.  Since  the 
expansion  coefficient  sequence  {b^^  in  figure  23  diverged  for  large  n,  the 
selection  of  n  =  15,  as  used  in  figures  24-26,  is  not  the  large  value  needed 
to  justify  the  use  of  (183)  and  (185).  Thus,  the  dashed  curves  on  figures  31 
and  32  must  be  considered  only  as  ball-park  estimates;  in  general,  the 
approximate  error  appears  to  be  too  conservative  in  these  two  figures. 
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Figure  31.  Estimated  Error  of  Figure  24 


Figure  32.  Estimated  Error  of  Figure  26 
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Finally,  the  Rice  variate  of  example  G  is  re-considered  in  figure  33.  We 
took  Fnv{b^a  3£-4  at  n  =  65,  by  extrapolating  in  figure  15  from  smaller  n, 
since  round-off  error  is  becoming  significant  by  this  value.  It  verifies  the 
unreliability  of  the  approximation  in  figure  33  for  u  >  7. 

Although  all  the  examples  in  this  report  have  the  capability  of 
evaluating  either  the  moments  or  the  cumulants  via  recursion,  this  is  by  no 
means  necessary.  Any  method  whatsoever  of  accurately  calculating  the  starting 
statistics,  be  they  moments  or  cumulants,  is  acceptable.  For  example,  if  a 
random  variable  with  known  probability  density  function  q  is  passed  through  a 
complicated  nonlinearity  g,  the  moments  of  the  output  are  given  by 

=  j"  du  g'^(u)  q(u)  .  (186) 

These  quantities  could  be  evaluated  for  0  £  n  £  N  by  brute-force  numerical 
procedures  if  necessary.  The  limit  value  N  will  depend  on  the  accuracy  with 
which  g  and  q  can  be  evaluated;  if  g(u)  2  0  for  all  u,  these  integrals  can  be 
accomplished  to  a  high  degree  of  accuracy,  thereby  allowing  large  values  of  N 
to  be  employed. 
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DISCUSSION 


Several  alternative  methods  have  been  presented  for  obtaining  either 
Hermite  or  generalized  Laguerre  series  expansions  of  probability  density 
functions  or  cumulative  and  exceedance  distribution  functions,  by  means  of 
recursive  relations  involving  either  moments  or  cumulants.  Furthermore, 
estimates  of  the  errors  of  the  approximations  are  furnished  so  that  the 
reliability  can  be  assessed.  Comparisons  between  approximations  obtained  by 
either  the  Hermite  or  the  generalized  Laguerre  series  afford  an  assessment  of 
the  accuracy  of  each;  also,  the  availability  of  three  alternative  recursive 
procedures  for  the  expansion  coefficients  allows  for  selection  of  the  best 
method  and  results,  and  determination  of  the  amount  of  round-off  ov-or. 

The  key  feature  to  this  approach  is  the  rapid  calculation  and  observation 
of  the  orthonormal  expansion  coefficients  Ib^l;  for  each  particular  guess  of 
weighting  parameters  a  and  g.  A  trial  and  error  procedure  is  suggested  for 
determining  a  and  a  values  that  yield  the  set  of  fastest-decaying  expansion 
coefficients.  From  observation  of  the  expansion  coefficients,  the  number  of 
terms  to  retain  in  the  series  expansions  is  ascertained,  being  sure  to  avoid 
the  effects  of  round-off  error  which  dominates  the  calculated  expansion 
coefficients  ^b^"^  for  large  n.  Since  the  amount  and  location  of  round-off 
error  on  the  plot  of  expansion  coefficients  also  depends  on  <x  and  a,  a 
judicious  search  may  be  required  to  find  acceptable  weighting  parameter 
values.  Of  course,  a  computer  with  a  larger  number  of  significant  digits 
would  greatly  alleviate  this  drawback;  the  particular  computer  used  for  all 
the  calculations  reported  here  is  the  Hewlett-Packard  9000  Model  520  which 
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devotes  52  bits  (15.65  decimal  digits)  to  the  mantissa  and  11  bits  to  the 
exponent.  Failure  of  the  technique  is  indicated  by  divergence  of  the 
expansion  coefficient  sequence 

Programs  for  the  shot  noise  process  considered  in  examples  0  and  I  are 
presented  in  appendix  F.  Times  of  execution  are  as  follows.  For  the  Hermite 
series,  the  80  cumulants  or  80  moments  required  as  input  for  figure  7  took  .7 
or  .35  seconds,  respectively.  The  calculation,  plotting,  and  display  of  the 
80  expansion  coefficients  in  figure  7  took  1.6  seconds  via  the  RC  approach  and 
1.75  seconds  via  the  two  moment  approaches.  The  computation  and  display  of 
the  100-point  plots  of  the  cumulative  distribution  function  in  figure  8  and 
the  probability  density  function  in  figure  9,  each  using  65  terms  in  the 
series  expansion,  took  1.1  and  .95  seconds,  respectively. 

For  the  generalized  Laguerre  series,  the  70  cumulants  or  70  moments 
required  as  input  for  figure  19  took  .54  seconds  or  .28  seconds, 
respectively.  The  calculation  and  display  of  the  70  expansion  coefficients  in 
figure  19  took  1.8  seconds  via  the  RC  approach  and  1.5  seconds  via  the  two 
moment  approaches.  The  computation  and  display  of  the  100-point  plots  of  the 
cumulative  distribution  function  in  figure  20  and  the  probability  density 
function  in  figure  21  took  1.1  and  .7  seconds,  respectively.  These  execution 
times  are  short  enough  to  allow  a  human  observer  to  conduct  a  rapid 
trial-and-error.  search  of  a,B  sr  ice,  determine  adequate  parameter  values,  and 
assess  their  accuracy. 

Alternative  exact  procedures  for  determination  of  cumulative  and 
exceedance  distribution  functions  via  characteristic  functions  have  been 
presented  in  [9,  10,  11].  Those  methods  generally  have  the  potential  for 
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greater  accuracy,  are  less  subject  to  round-off -error,  and  would  be  preferred 
if  possible.  However,  analysis  of  systems  with  nonlinearities  and  memory 
sometimes  precludes  or  greatly  hinders  their  application;  in  such  cases,  the 
current  approach  is  a  very  good  candidate  for  consideration. 

The  two  weightings  in  (1)  and  (2),  namely  the  Hermite  and  generalized 
Laguerre,  have  been  investigated  rather  intensively  here,  because  so  many 
properties  and  recursions  are  available  for  the  corresponding  (orthonormal) 
polynomials.  These  properties  have  been  utilized  to  derive  simple  recursive 
relations  for  the  expansion  coefficients  and  density  and  distribution 
functions,  thereby  realizing  quick  efficient  procedures  for  numerical 
evaluation  and  observation. 

It  would  be  extremely  useful  to  be  able  to  extend  these  results  to  the 
weighting 

u“  exp(-u^/0^)  for  u  >  0,  (187) 

since  this  class  of  probability  density  functions  is  often  encountered  in 
nonlinear  systems  with  Gaussian  inputs.  However,  there  are  several  pivotal 
recursive  relations  for  the  corresponding  orthonormal  polynomials  that  would 
be  needed,  and  it  is  questionable  if  a  fast  procedure  could  be  devised  without 
them.  Also,  it  is  unknown  if  recursive  procedures  for  the  expansion 
coefficients  in  terms  of  moments  or  cumulants  could  be  derived,  as  was  done 
here  for  the  Hermite  and  generalized  Laguerre  weightings.  This  is  a  topic 
worthy  of  further  investigation. 
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APPENDIX  A.  COEFFICIENT  RECURSION  FOR  EXPONENTIAL  OF  POWER  SERIES 


oo 


Suppose  power  series  ^  h„  converges  for  some  Izl  >0,  and 

n=0  " 

exponentiate  it,  getting  a  new  power  series 


we 


oo 


n=0 


9n  z  =  exp  ) 


oO 


n=0 


1 

Z  '  . 

"  J 


(A-l) 


Then  the  lowest  order  coefficient  is 

gQ  =  exp(hQ)  , 

while  for  k  >  1,  we  have 


(A-2) 


/  r  I"" 

9k  ’  ITT  (ar)  hn  2"  ■ 

(.n=0  J  -*2=0 


_  _1  ^  „  h  jn-ll  r,  J' 

~  If  •  Ir)  JiH^)  I  1  { d7  J  I  e^P 

p=0  '‘P/W2/  n  ^2=0  L 

^  ^P^^  ^'^"''■P^'  9k-l-p  = 


'z-0 


k-1 

P 
k-1 


p=0 


(p+1)  h„.,  g. 


1 


p+1  ^k-l-p  ”  k 


m=:l 


^  9k-Hn 


(A-3) 


Thus  we  have  the  recursion  for  coefficients  [g^^  in  terms  of  the 


^k  k 


m  h. 


m=l 


m 


9k-ffl  2:  1.  Do  =  exp(hQ) 


(A-4) 
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If  we  now  refer  to  (6)  and  (7)  and  identify 
%  -  •  "n  -\l”'  • 

there  follows  the  moments  in  terms  of  the  cumulants  according  to 

i-k  =  ^  Vk-m  “n.  fo’’  "  i  1*  "0  ”  • 

m=0  '  ' 


(A-5) 


(A-6) 


This  is  a  slight  generalization  of  [6,  (10)].  This  equation  is  immediately 
inverted,  to  yield  the  cumulants  in  terms  of  moments; 

*^k  "  \  ~  ^  ('^m^^-m  *'m  k  >  1,  ^  =  ^n  ,  (A-7) 

1—  _ 

which  generalizes  [6,  (11)]. 

In  terms  of  the  normalized  cumulants  and  moments  defined  in  (62)  and 
(69)  respectively,  we  have 

\  ’  r  ^^k^  “n,  “0  -  ’  <*-8) 

m=0 

and 

ik  ■  5^  “k  -  §  ^k^  i  1’  "o)  • 


94 


TR  7377 


APPENDIX  B.  EXPANSION  OF  He^(x+y) 


The  quantity  He^(x+y)  is  a  polynomial  of  degree  n  in  y.  Therefore  we 


can  expand 


n  m 

He„(x*y)  -  S  ^  • 

m=0 


(B-1) 


where  Ym  will  also  depend  on  n  and  x.  In  fact. 


"(irT  ^  ["  •  "("-I*  ••• 


“  TfwfDT  ^n-ffl'^^  * 


(B-2) 


where  we  used  [5, 

,  22.8.8] 

repeatedly. 

alternative  forms  for  the 

expansion, 

He^(x+y)  = 

He„^(x)  /- 

(-) 

m=0  '  • 

s 

I© 

He|^(y)  x""*^ 

{B-3) 
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APPENDIX  C.  EVALUATION  OF  I^(y)  IN  (94) 


We  have,  from  (94), 


I^(y)  ^  dx  x“  e~*  L^“^{x)  for  n  >  0  . 


(C-l) 


pS  a+1  -y 

l^iy)  »  I  dx  x“  e-’^  1  =  Y(«n,y)  *  ^  ^F^(l;a+2;y), 

using  [5,  22.4.7,  6.5.2,  and  6.5.12].  Also,  we  have  from  [5,  22.11  6], 


(C-2) 


e-*  x“*"1 


(C-3) 


Then  for  n  >  1,  (C-l)  can  be  developed  as 


i„(y)  *  ( <>*  (df)  J®'*  *“*"]  ’ 

■  i!T  •  i?r  (d^"'"  [®‘"  >“i  - 


(C-4) 


where  we  set  the  lower  limit  of  the  evaluated  integral  to  zero  since 
o'hri  >  a+1  >  0. 
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APPENDIX  D.  FOURIER  TRANSFORM  OF  GENERALIZED  LA6UERRE  POLYNOMIAL 

We  wish  to  evaluate  transform 

00 

A(a.)  =  f  dt  e^“^  t“  e'^  L^“^(t)  .  (D-1) 

*^0 

Now 

nl  t“  e“^  L^“^t)  =  t®"^]  for  n  >  0  ,  (D-2) 

according  to  [5,  22.11.6].  Therefore  for  n  ^  1. 

n;  A(„)  ,  J  dt  (^y  t”^]  - 

-  --  r « (dff  h'"  ‘“i  •  (°-3) 

where  we  used  integration  by  parts  with  the  fact  that  the  integrated  part  is 
zero  at  t  =  0  and  *0,  since  o^hi  >  a+1  >  0.  Repeated  integration  by  parts  then 
yields 

06 

n:  A(«)  =  (-ia>)"  J  dt  e^"^  e"^  t®'*'"  =  p(o+l+n)  -  •  (^-4) 

■^0  (1-itt))® 

This  is  the  result  quoted  in  (104). 
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APPENDIX  E,  RECURRENCE  FOR  EXAMPLE  C 


The  starting  point  is  the  moment  expression  in  (142): 


n+2h  /„  \ 


where  h  =  (y'^J’‘’1)/2,  z  =  ute  /4.  Denote  the  term  in  (E-l)  by 
F^,  and  the  leading  factor  by  6^;  thus  =  6^^  F^.  There  follows 


immediately 


G  =  G  „  ui^/^+h-l)  for  n  >  2  . 

n  n-2  \.2  /  — 


For  the  iF^  function,  we  refer  to  [5,  13.4.1]  to  get 

•"n  “  "in  7  ^-4]  ' 


(E-l) 


(E-2) 


{E-3) 


If  we  substitute  (E-2)  and  (£-3)  into  =  G^  F^,  and  then  re-apply 
(E-2)  in  the  second  term,  we  obtain 

=  u»^(n+Y-2+z)  y^_2  -  o>^  [jn+Y-3)^  ; 

we  also  eliminated  h.  Starting  values  for  can  be  obtained  from  (E-l). 


(E-4) 


For  the  special  case  (143)  and  (144),  (E-4)  reduces  to 


y^  =  u^(n-l+z)  y^_2  -  j  a»^(n-2)^  y^_^ 


(E-5) 
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with  starting  values 


uq  =1.  » 

^2  =  <D^(l‘‘‘z), 


1 

2 


f  Ut  6  ^  ^2  i  i  f  2  )  ♦ 


3  /3  3  ^-z  c  ^ 
^  ir  e 


(E-6) 


Kummer's  transformation  [5,  13.1.27]  was  employed  in  this  last  equation;  these 
forms  afford  accurate  starting  values  for  recursion  {E-5). 
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Eight  programs  are  listed  in  this  appendix.  They  are  given  in  BASIC  for 
the  Hewlett  Packard  9000  Model  520  computer.  For  ease  of  reference,  a 
shorthand  notation  is  adopted: 


P 

denotes 

cumulative  or  exceedance  distribution  function 

p 

denotes 

probability  density  function 

H 

denotes 

Hermite  expansion 

L 

denotes 

generalized  Laguerre  expansion 

RC 

denotes 

recursively  via  cumulants 

DM 

denotes 

directly  via  moments 

RM 

denotes 

recursively  via  moments 

Table  F-1.  Shorthand  Notation 

Then,  for  example,  the  combination  PHRC  means  that  this  program  yields  the 
cumulative  or  exceedance  distribution  function  in  terms  of  a  Hermite 
expansion,  by  means  of  expansion  coefficients  determined  recursively  via 
cumulants.  The  eight  programs  listed  here  are,  in  order. 
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PHRC 

Figures  7  and  8 

pHRC 

Figures  7,  9,  and  10 

PHDMandRM 

Figures  7  {and  8) 

pHDMandRM 

Figures  7  (and  9,  10) 

PLRC 

Figures  19  and  20 

pLRC 

Figures  19,  21,  and  22 

PLDMandRM 

Figures  19  (and  20) 

pLDMandRM 

Figures  19  (and  21,  22) 

Table  F-2.  Program  Abbreviations 

The  combination  OMandRM  means  that  this  program  gives  the  expansion 
coefficients  directly  via  moments  as  well  as  recursively  via  moments;  the  user 
must  select  the  procedure  of  interest. 

The  only  input  statistics  we  have  given  a  listing  for  here  is  the  shot 
noise  process  used  in  examples  D  and  I;  in  particular,  the  cumulant  and  moment 
routines  are  listed  at  the  very  end  of  PHRC  and  PHDMandRM,  respectively.  The 
figure  references  given  in  table  F-2  indicate  where  each  particular  program 
was  used  in  this  report;  the  parenthetical  references  are  alternative  ways  of 
generating  those  figures.  The  remaining  figures  in  this  report  require  that 
the  cumulant  and  moment  subroutines  be  replaced  by  the  appropriate  statistics 
of  interest. 
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To  save  space,  no  subroutines  are  listed  more  than  once;  instead, 
comments  are  made  indicating  where  the  needed  routines  are  located,  according 
to  the  coding  in  table  F-2.  For  example,  in  program  PHWandRM,  function 
subprogram  FNPhi,  line  570,  the  conment  is  made  that  this  routine  has  already 
been  listed  in  PHRC. 

We  now  explain  some  of  the  details  of  the  PHRC  program,  as  an  example,  so 
that  a  user  can  apply  these  techniques  and  routines  to  his  particular 
problem.  The  user  must  specify  M  in  line  30,  which  is  the  maximum  order  of 
approximation  desired,  or  the  number  of  cumulants  or  moments  that  can  be 
calculated.  The  notation  DOUBLE  in  line  40  denotes  INTEGER  variables.  The 
user  must  select  a  and  &  in  lines  130,140;  if  they  are  chosen  equal  to 
aQ,BQ  which  have  been  computed  in  lines  110,120,  then  expansion 
coefficients  a^^  =  a2  =  0,  or  equivalently  b^  =  b2  =  0.  However,  this 
choice  is  recommended  only  as  a  starter  on  the  search  in  a,$  space. 

The  CALL  in  line  150  is  to  the  subroutine  which  calculates  the  expansion 
coefficients  for  a  Hermite  series,  recursively  via  cumulants,  as  can  be 
deciphered  from  the  abbreviated  subroutine  title.  The  expansion  coefficients 
{bjj^are  calculated  and  the  running  sum  of  b^  is  calculated,  both  of 
which  are  printed  on  the  CRT  vs  n.  Also,  a  plot  of  the  expansion  coefficients 
|)^\is  made  in  this  subroutine,  from  which  the  user  ?nust  decide  on  the  order, 

N,  to  employ  in  the  approximate  cumulative  and  exceedance  distribution 
function;  alternatively,  he  can  reject  the  sequence  o^[bJso  obtained,  and 
re-run  the  program  with  different  a, a  values. 
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When  a  satisfactory  a,e  pair  is  obtained,  the  limits  Uj^,U2  on  the 
range  of  arguments  of  the  distribution  must  also  be  specified;  this  selection 
is  aided  by  the  print-out  of  the  center  and  rms  width  of  the  density  under 
investigation.  A  plot  of  100  values  of  the  cumulative  and  exceedance 
distribution  functions  is  then  made  on  a  logarithmic  ordinate.  The  various 
subroutines  are  self-explanatory  and  are  keyed  to  the  equation  numbers  in  this 
report. 
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PROGR/^  PHRC 


i0 
20 
30 
40 
50 
60 
70 
S0 
90 
100 
1  10 
120 
130 
140 
150 
160 
1  70 
180 
190 
200 
210 
220 
230 
240 
250 
260 
270 
280 
290 
300 
310 
320 
330 
340 
350 
360 
370 
380 
390 
400 
410 
420 
430 
440 
450 
460 
470 
480 
490 
500 
510 
520 
530 
540 


r  A  r  C 


STEP  PLUS  CONTINUOUS  PART  OF  SHOT  NOISE  CDF,  Pc  u  '  TR  37 

OF  HEkMITE  EKPflHSION  FOUND  RECURSIVELY  VIR  CUHULRNlS 

ORDER  OF  RPPROJilMRTION;  NUMBER  OF  CUMULRNTS  PEOUIPED 


COEFFICIENTS 
h=S0  !  MRXIMUM 


DOUBLE  M,I,N,K 
RED  I M  Cufii '!  0 :  M  > ,  R  (  0 ;  M  > ,  Hs-  <  0 :  M  > 

RERL  Cum  0 :  1 00  > ,  R  <  0 ;  1 00  > ,  He  <  0 :  1 00  > 
CFiLL  Cumu  1  ant  s  >;  M ,  P0 ,  Cum <  *  )  > 

Cent  e r-Cum  ■'  1 ) 

R2  =  Cum ( 2  > 


!  INTEGERS 


31  = 


147, 483, 64S 


.  P(0: 100> 

P0  IS  STEP  RT  ORIGIN 
CENTER  OF  PDF  r 
HERN  SQURRE  SPRERD  OF 


Rms =SQR  C  R2 
R 1 ph  a0=Cent  er 
E:  e  t  -^0 = R  m  s 


RMS  SPREAD  OF  pcOu) 

THE  CHOICES  fl 1 ph a=R 1 ph aO  RND 
Beta=Beta0  WOULD  MAKE  A'  1  :*  =  R‘2'=0 


A 1 pha=Cent  er 
Beta®Rms*-l .  5 


CALL  Coef f hr_u i a_c urn ( M , A 1 pha, Bet  a, Cum < * ) , A< * > '  !  RC 

PRINT  "Center  =  Center 
PRINT  "Rms  *";Rms 
Fl  =  l .  ■'SQR<2.  *PI  > 

INPUT  "ORDER  AND  L I M I TS ; " , H, U 1 , U2 
PRINT  "ORDER  AND  L I M I TS : " , N ; U 1 ; U2 
Du=':;U2-Ul  ).'100. 

PLOTTER  IS  "GRAPHICS" 


GRAPHICS  ON 
WINDOW  U1 , U2, -10. , 0. 
GRID  Du* 10. , 1 . 

FOR  1=0  TO  100 
U=Ul+Du*I 
T  =  < U-A 1  »5ha>  'Bet a 
CALL  H  te<N,T,He<*)> 
Sum=0 . 

FOR  K=1  TO  N 

Sum  =  Sum-*-A  <  K  >  *He  <  K- 1  > 


NEXT  K 

P  =  fl<0;:'*FNPhi  <T;'-F1*EXP':;-.  5*T*T:>*Sum  '  PROBABILITY  THAT  RV  •  ij 

IF  U>=0.  THEN  P=P+P0  !  ADDITION  OF  STEP  RT  ORIGIN 


P< I >=P 


IF  P>0.  THEN  400 

PENUP 

GOTO  410 

PLOT  U.LGTCP) 

NEXT  I 

PENUP 

FOR  1=0  TO  100 


U=Ul+Du*I 


Pl  =  l . -P<  I ) 

IF  P1>0.  THEN  490 

PENUP 

GOTO  500 

PLOT  UjLGTCPl) 

NEXT  I 

PENUP 

GOTO  190 

END 


I 
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PROGRAM  PHRC  (confd) 


550  DEF  FHPhi<X>  !  HftRT,  page  140,  »5708  &  #5725  eq.  41 

560  Y  =  FlES  (.  SQR  .  5  >  '• 

570  SELECT  Y 

580  CfiSE  <8. 

590  P=1631 . 7602687537  1470  +  Y*(:  456.  26 1 45870609263 1 +Y*  <  86 . 0827622  1  1  94  8595  1  +  r* 

(  10. 06485S9749095425  +  Y*. 564 18958676 1 813614) >) 

600  P  =  3723. 58798155480672+Y«<71 13. 66324695404987+Y* (.6753. 2169641 104S5S9  +  ’,> 

(4032.26701083004974  +  7*8))  ) 

610  Q  =  7542. 4795101 9347576  +  Y*<2968. 00490148230872  +  Y*<81 7. 622386304544  077  +  Y* 

( 153. 0777 107503622 16+Y*< 17.839498439 1395565+Y)))) 

620  Q  =  3723. 50798155480654  +  Y*< 1 1315.  1920813544055  +  Y*( 15802. 5359994020425  +  Y* 

<  13549. 34656 1 2844574  +  Y  +  Q) )  ) 

630  Phi=.5*EXP<-Y*Y>*P/Q 

640  CASE  <26.6 

650  P  =  2. 97886562639399239  + Y*(  7. 40974060596474  179  + Y*(  6.  I  60209853  1  0963054 +Y-^ 

(5. 01904972673426746+Y*< 1 . 27536664472996595+Y* . 5641 89583547755074 >  > ) ) 

660  Q=3. 36907520698275277+Y*<9. 60896532719278787+Y*( 17. 0814407474660043  , - 

c  12. 0489519278551290  +  Y*<9.  39603401623505415  +  Y*(2. 26052S52076732697  +  Y)  ) )  > 

670  Phi  =.5*EXP(;-Y*Y)*P/Q 

680  CASE  ELSE 

690  Phi=0. 

700  END  SELECT 

710  IF  X>0.  THEN  Phi=l.-Pht 

720  RETURN  Phi 

730  FNEND 

740  ! 

750  SUE  Herm i t e < DOUBLE  N,REflL  X,He(*))  !  He/n(X)  eq.  50 

760  DOUBLE  K, 

770  He<0)=l. 

780  He(l)=X 

790  FOR  K.  =  2  TO  N 

800  He(;K)=X*He<K-l  )-<K-l  )*He<K-2) 

810  NEXT  K 

320  SUBEHD 

830  ! 

840  SUE  1  a_cijmrit  ( DOUBLE  M,RERL  Cum ( * )  ,  Mom C ♦ )  )  f  eq.  A-6 

850  DOUBLE  K,J 

860  REAL  Mom0 

870  Mom(.0)=Mom0=EXP(Cum<0) ) 

880  FOR  K=1  TO  M 

890  T=l. 

900  S=Cum(K)*Mom0 

910  FOR  .J=l  TO  K-1 

920  T  =  T*<K-J)/'.J 

930  S=S+T*Cum<K-J)*Mom< J) 

940  NEXT  J 

950  Motn(K:)=S 

960  NEXT  K 

970  SUBEND 

980  ! 
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PROGRAM  PHRC  (conf  d) 


990  SUB  Ct4mnt  _v  i  a_morimt  ( DOUBLE  M,REflL  Mom <  ♦  >  ,  Cum (  »  >  )  !  cq.  fi-7 

1000  DOUBLE  K,J 

1010  REAL  Home 

1020  Mon)0  =  f1om<0) 

1030  Cum<0>=LOG<Mom0) 

1040  FOR  K=1  TO  M 

1050  T=l. 

1060  S=Mom(K) 

1070  FOR  J=1  TO  K-1 

1080  T  =  T*c;K-J>,' J 

1090  S*S-T*Mom<J>*Cum<k-J) 

1100  NEXT  J 

1110  Cum<K)=S/Mom0 

1120  NEXT  K 

1130  SUBEND 

1140  ! 

1150  SUB  Coef  f  hr'_u  i  a_c  urn <  DOUBLE  M,REAL  ft  1  pha,  Bet  a,  Cum <  *  >  ,  fl <  ♦  )  > 

1160  ALLOCATE  B<:0;M) 

1170  DOUBLE  K,J,Mx 

1180  F=Beta*Beta 

1190  Cum<l)=<Cum<l>-ftlpha)xBeta  !  MODIFIED  NORMALIZED 

1200  Cum<2>*Cum(2)-'F-l .  !  CUMULftNTS  FOR  K=1  8c  2;  eq.  63 

1210  FOR  K=3  TO  M 

1220  F  =  F*Beta*<K--l  ) 

1230  Cum<K:'*Cum<K)/F  !  NORMALIZED  CUMULftNTS;  eq.  62 

1240  NEXT  K 

1250  ft<0)=B<0)=EXP<Cum<0>) 

1260  F=l. 

1270  FOR  k=l  TO  M 

1280  S=0. 

1290  FOR  J=1  TO  K 

1300  S=S+Cum< J)*fl<K-J) 

1310  NEXT  J 

1320  fl<K)=S/K 

1330  F=F»K 

1340  B<K)=A<K)*SQR<F) 

1350  NEXT  K 

1360  Mx*Mx+10 

1370  IF  Mx<M  THEN  1360 

1380  Threshol d=-7. 

1390  T2=Threshold*2. 

1400  V=10. -^Threshol  d 

1410  GINIT 

1420  PLOTTER  IS  "GRAPHICS" 

1430  GRAPHICS  ON 

1440  WINDOW  0. ,FLT<Mx),T2,0. 

1450  LINE  TYPE  3 
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PROGRAM  PHRC  (cont'd) 


1460 
1470 
1480 
1490 
1500 
1510 
1520 
1530 
1540 
1550 
1560 
1570 
1580 
1590 
1600 
1610 
1620 
1630 
1640 
1650 
1660 
1670 
1680 
1690 
1700 
1710 
1720 
1730 
1740 
1750 
1760 
1770 
1780 
1  79>< 
1800 
18i:) 
1820 
1830 
1840 
1850 
i860 
1870 
1880 
1890 
1900 
1910 


FOR  J=0  TO  Hx  STEP  18 
MOVE  J,T2 
DRRW  J,0. 

NEXT  J 

FOR  J=T2  TO  0 
MOVE  0. , J 
DRfiW  Mx,J 
NEXT  J 
PENUP 

LINE  TYPE  1 

IMAGE  4D,2<4X,M. 17DE) 

PRINT  '•  K  B<K)  Sum" 

Sum=0. 

FOR  K=0  TO  M 
B=B<K) 

Sum=Sum+B*B 

PRINT  USING  1560; K, B, Sum 
IF  B<V  THEN  1660 
Y=LGT<B) 

GOTO  1700 

IF  B>-V  THEN  1690 

Y=T2-LGT<-B> 

GOTO  1700 
Y=Thr€rsho  1  d 
PLOT  K,Y 
NEXT  K 
PENUP 
SUBEND 


SUB  Cumul ants (DOUBLE 
Ouer 1 ap=6. 2 
S  i  gm  aa=  1 . 
P0=EXP(-Ouer 1 ap) 
ALLOCATE  Mc.m<0;M) 
DOUBLE  K 
S=S i gmaa*S i gmaa 
Cum<0>=0. 


MjREAL  P0,Cum<*)>  *  SHOT  NOISE  eqs.  147-150 

!  RV.  NO.  PULSES/SEC  *  AVERAGE  PULSE  DUR^tTION 
!  PARAMETER  OF  RAYLEIGH  AMPLITUDE  PDF 
!  PROBABILITY  OF  ZERO  AMPLITUDE  OF  SHOT  M'ISE 
!  ARRAY  FOR  MOMENTS 


Cufn<  1  JsQverl  ap*Si  gmaa*.  25*PI*SQR(  .  5*PI ) 
Cum < 2 >  =Oui&r  1  ap*S*4.  x3. 

FOR  K=3  TO  M 


Cum  f.  K  >  =Cum  <  K.-2  >  *S*K*K.  -  ( K+ 1  > 

NEXT  K 

CALL  Momnt_vn  a_c  umnt  <M , Cum(*> , Mom <  *>  > 

Mom<0>=Mom<0)-P0  !  MOMENT  CORRECTION  FOR  IMPULSE  AT  ORIGIN 

CALL  Cumnt_ui a_momnt  CM, Mom<*> ,Cum(*) ) 

SUBEND 


UO 
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PROGRAM  pHRC 


10  ! 

CONTINUOUS  PfiRT  OF  SHOT  NOISE 

PDF,  pc<u) 

TR  7377,  FIGURE  9 

20  ! 

COEFFICIENTS  OF  HERMITE  EXPANSION  FOUND  RECURSIVELY  VIA  CUMULANTS 

30 

M=S0  !  MAXIMUM  ORDER  OF  APPROXIMATION;  NUMBER 

OF  CUMULANTS  REQUIRED 

40 

DOUBLE  M,I,N,K 

'  INTEGERS  <  2-- 

31  =  2, 147,433,648 

50 

REDIM  Cum<0: M) , A(0! M) , He<0; M) 

60 

REAL  Cum<0; 100), A<0; 100),He<0: 

100) 

70 

CALL  Cumul ants<M, P0,  Cum<*) ) 

!  P0  IS  STEP  AT 

ORIGIN 

80 

Cent  er=Cum ( 1 > 

!  CENTER  OF  PDF 

pc  <  u  > 

90 

R2  =  Cum<  2 ) 

!  MEAN  SQUARE  SPREAD  OF  pen) 

100 

R  fii  s = S  Q  R  ( R  2 ) 

!  RMS  SPREAD  OF 

pc  <  u ) 

110 

AT  ppha0=Center 

!  THE  CHOICES 

Alpha=AlpHa0  AND 

120 

Bet  ■a0=Rms 

'  Beta=Beta0 

WOULD  MAKE  AC  1  )=A'::2 '=0 

130 

A 1  phai='''enter 

140 

Bet  a=Rrfis*  1 . 5 

150 

CALL  Coeffhr_Mi  a_cum<M,  A1  pha-  *■ 

t  a, Cum (♦),A<^>) 

!  RC 

160 

PRINT  “Center  =  ";Center 

170 

PRINT  "Rms  =";Rms 

1S0 

Fl  =  l .  ^'<Beta»SQR<2.  ♦PI  )  ) 

190 

INPUT  "ORDER  AND  LIMITS! '’,N, 

U1,U2 

200 

PRINT  "ORDER  AND  LIMITS: ", N; U1 

;U2 

210 

Du=<U2-Ul )  '100. 

220 

PLOTTER  IS  "GRAPHICS" 

230 

GRAPHICS  ON 

240 

WINDOW  U1,U2,0. , .  15 

250 

GRID  6. , . 03 

260 

FOR  1*0  TO  100 

270 

U=Ul+Du^I 

280 

T  =  <U-A1  pha)/Bet.a 

290 

CALL  Hermi t e<N, T, He< * )  ) 

300 

Sum=R<  0) 

310 

FOR  K=1  TO  N 

320 

Sunfi  =  Sum+A  <  K )  ♦He  <  K ) 

330 

NEXT  K 

340 

P=F1^EXPC-. 5^T^T>^Sum 

!  PDF  OF  RV  AT  U 

350 

PLOT  U,P 

360 

NEXT  I 

370 

PENUP 

380 

GOTO  190 

390 

END 

400 

!  USE  ROUTINES  IN  PHRC 
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PROGRAM  PHOMandRM 


10 

20 

30 

40 

50 

60 

70 

80 

90 

100 

110 

120 

130 

140 

150 

160 

170 

180 

190 

200 

210 

220 

230 

240 

250 

260 

270 

280 

290 

300 

310 

320 

330 

340 

350 

360 

370 

380 

390 

400 

410 

420 

430 

440 

450 

460 

470 

480 

490 

500 

510 

520 

530 

540 

550 


STEP  PLUS  CONTINUOUS  PART 
HERMITE  EXPANSION  FOUND  DI 
M=80  !  MAXIMUM  ORDER 

DOUBLE  M, I,N,K 
REDIM  Mom(0;M),A<0:M>,He< 


REAL  Mom<0: 100), A<0; 100) 

CALL  Moment s < M , P0 , Mom <*) ) 
Center=Mom<  1  )-'Mom<0) 

R2=Mom  <  2  ).'  Mom  (0)  -Cent  er*Cent  en 
Rms=SQR<R2) 

AT  pha0=Center 
Bet  a0=Rms 

A1 pha=Centen 
Beta*Rms*l . 5 

CALL  Coef f hd_o i a_mom < M , A 1 
CALL  Coef fhr_oi a_mom<M, AT 
PRINT  "Center  =  "jCenter 
PRINT  "Rms  =";Rms 
F1  =  1..'SQR<2.*PI) 


OF  SHOT  NOISE  CDF, 
RECTLY  VIA  MOMENTS 
OF  APPROXIMATION; 

!  INTEGERS 

0SM) 

He <0: 100), 


PcCu);  COEFFICIENTS  OF 
OR  RECURSIVELY  VIA  MOMENTS 
NUMBER  OF  MOMENTS  REQUIRED 


2''31  =  2,14: 


,483,648 


P<0; 100) 

P0  IS  STEP  AT  ORIGIN 
CENTER  OF  PDF  pc<u> 
MEAN  SQUARE  SPREAD  OF 
RMS  SPREAD  OF  pc<u) 


p  c  <  u ) 


THE  CHOICES 
Bet  a^^Bet  a0 


pha, Beta,Mom<»),A<*>) 
pha, Bet  a, Mom (*),A<*)> 


A1pha=Alpha0  AND 
WOULD  MAKE  Aa>=A<2>=0 


DM 

RM 


INPUT  "ORDER  AND  L I M I TS ; " , N, U1 , U2 
PRINT  "ORDER  AND  L IM I TS : " , H; Ul ; U2 
Du*<U2-Ul )/100. 


PLOTTER  IS  "GRAPHICS" 
GRAPHICS  ON 
WINDOW  U1,U2,-10, ,0. 
GRID  Du*10. , 1 . 

FOR  1=0  TO  100 
U=Ul+Du*I 


T=  <  U-AI  pha)  Beta 
CALL  Hermi te<N, T, He(*> ) 

Sum=0. 

FOR  K=i  TO  N 
Sum=Sum+A<K)*He<K-l ) 

NEXT  K 

P=A<0)*FNPhi <T)-Fl*EXP<-.5*T*T)*Sum  !  PROBABILITY  THAT  RV  <  U 

IF  U>=0.  THEN  P=P+P0  !  ADDITION  OF  STEP  AT  ORIGIN 

P<I)=P 

IF  P>0.  THEN  410 
PENUP 
GOTO  420 
PLOT  U,LGT<P) 

NEXT  I 
PENUP 

FOR  1=0  TO  100 

U=Ul+Du»I 

Pl=l.-P<4) 

IF  P1>0.  THEN  500 

PENUP 

GOTO  510 

PLOT  U,LGT<P1) 

NEXT  I 
PENUP 
GOTO  200 
END 
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PROURm  PHDMandRM  (conf  d) 


see  DEF  FNPhi<X>  !  HART,  page  140,  #5708  8<  #5725 

570  !  LISTED  IN  PHRC 

740  FNEND 

750  ! 

760  SUB  Hermite<DOUBLE  N,REflL  X,He<*>)  !  He-^n<X) 

770  !  LISTED  IN  PHRC 

830  SUBEND 

840  ! 

850  SUB  Hertni  te_i  <DOUBLE  N,REflL  X,Hi<*))  •  Hi /'n<X)*<-i  ) '■n  He^r.<iX>  eq.74-5 

860  DOUBLE  K  !  MODIFIED  HERMITE  POLYNOMIALS 

870  Hi<0)*l. 

880  Hi<l>=X 

890  FOR  K*2  TO  N 

900  Hi <K)=X*Hi (K-1 >+<K-l >»Hi <K-2) 

910  NEXT  K 

920  SUBEND 

930  ! 

940  SUB  Momnt_gi  a_cufrint  (DOUBLE  M,REAL  Cum<*)  ,  Mom<*) ) 

950  !  LISTED  IN  PHRC 

1070  SUBEND 

1080  ! 

1090  SUB  Coeffhd_Mia  motnCDOUBLE  M,REAL  A1  pha,  Bet  a,  Mom  <  *  >  ,  A  <  ♦  )  > 

1100  ALLOCATE  He<0: m7, F<0: M) , B(0! M) 

1110  DOUBLE  K,J,Mx 

1120  CALL  Hermi te<M, -A1 pha/Beta, He<*) ) 

1130  T=F<0)=1. 

1140  FOR  K*1  TO  M 

1150  F»F<K)=F<K-l)*K 

1160  T«T*Beta 

1170  He<K)=He<K)/F  !  NORMALIZED  HERMITE  POLYNOMIALS;  eq.  68 

1180  Mom<K)=Mom<K)x<F*T)  !  NORMALIZED  MOMENTS  re  Beta;  eq.  69 

1190  NEXT  K 

1200  FOR  K*0  TO  M 

1210  S=0. 

1220  FOR  J*0  TO  K 

1230  S=S+He< J)*Mom<K-J) 

1240  NEXT  J 

1250  A<K)=S 

1260  NEXT  K 

1270  MAT  F*SQR<F) 

1280  MAT  B*A.F 

1290  Mx=Mx+10 

1300  IF  Mx<M  THEN  1290 

1310  Threshol d=-7. 

1320  T2=Threshold*2. 

1330  V=10. -'Threshol  d 

1340  GINIT 

1350  PLOTTER  IS  "GRAPHICS" 

1360  GRAPHICS  ON 

1370  WINDOW  0. ,FLT<Mx),T2,0. 

1380  LINE  TYPE  3 
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PROGRAM  PHDMandRM  (cont'd) 


1390  FOR  J=0  TO  Mx  STEP  10 

1400  MOVE  .J,T2 

1410  DRAW  J,0. 

1420  NEXT  J 

1430  FOR  J=T2  TO  0 

1440  MOVE  0. , J 

1450  DRfiW  Mx,J 

1460  NEXT  J 

1470  PENUP 

1480  LINE  TYPE  1 

1490  IMAGE  4D,2<4X,M. 17DE) 

1500  PRINT  '•  K  B<K)  Sum" 

1510  Sum=0. 

1520  FOR  K=0  TO  M 

1530  B=B<K> 

1540  Sum=Sum+B*B 

1550  PRINT  USING  1490;K,B,Sum 

1560  IF  E<V  THEN  1590 

1570  Y=LGT<B) 

1580  GOTO  1630 

1590  IF  B>-V  THEN  1620 

1600  Y=T2-LGT<-B) 

1610  GOTO  1630 

1620  Y=Thresho1d 

1630  PLOT  K,Y 

1640  NEXT  K 

1650  PENUP 

1660  SUBEND 

1670  ! 

1680  SUB  Coef f hr_ui a_mom<DOUBLE  M,REAL  A1  pha,  Bet  a,  Mom< * >  ,  A < ♦ > > 

1690  ALLOCATE  Hi  (0;  M> ,  F<0:  M)  ,  B<0;  t1) 

1700  DOUBLE  K.,J,Mx 

1710  CALL  Herm i t e_i <M , A 1 phaxBet a, Hi < * > > 

1720  T=F<0>=1. 

1730  FOR  K=1  TO  M 

1740  F=F<K)=F<K-1 )*K 

1750  T=T*Beta 

1760  Hi <K)=Hi <K)xF  !  NORMALIZED  MODIFIED  HERMITE  POLYNOMIALS;  eqs.  80  &  74 

1770  Mrm<K)=Mom<K)xc:F»T)  !  NORMALIZED  MOMENTS  re  Beta;  eq.  69 

1780  NEXT  K 

1790  FOR  K=0  TO  M 

1800  3=Mom<K) 

1810  FOR  J=1  TO  K 

1820  S=S-Hi ( J)*A<K-J) 

1830  NEXT  J 

1840  A<K>=S 

1850  NEXT  K 

I860  MAT  F=SQR<F) 

1870  MAT  B*A.F 
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PROGR/W  PHOMandRM  (cont'd) 


Mx=Mx+10 

IF  Mx<M  THEN  1830 
Thresho 1 d=-7 . 

T2=Thr6  sho  1  cl*2 . 

V=  1 0 .  ■•'Thresho  1  d 
GINIT 

PLOTTER  IS  "GRAPHICS" 

GRAPHICS  ON 

WINDOW  0.  ,FLT<rix),  T2,0. 

LINE  TYPE  3 

FOR  J=0  TO  Mx  STEP  10 

MOVE  J,T2 

DRAW  .J,0. 

NEKT  J 

FOR  .J  =  T2  TO  0 
MOVE  0. , J 
DRAW  Mx,J 
NEXT  J 
PENUP 

LINE  TYPE  1 

IMAGE  4D,2<4X,M. 17DE) 

PRINT  "  K  BCK)  Sum" 

Sum=0 . 

FOR  K=0  TO  M 

b=b<:k) 

Sum=Sum+B*B 

PRINT  USING  2080; K,B, Sum 
IF  B<V  THEN  2180 
Y^LGTCB) 

GOTO  2220 

IF  B>-V  THEN  2210 

Y=T2-LGT<-B) 

GOTO  2220 
Y  =  Thr  esho 1 d 
PLOT  K,Y 
NEXT  K 
PENUP 
SUBEND 


SUB  Moment s < DOUBLE  M,REAL 
0uerlap=6.2  ! 

Sigmaa=l.  ! 

P0=EXP<-Overlap)  ! 

ALLOCATE  Cum<0!M)  ! 

DOUBLE  K 
S=S i gmaa*S i gmaa 
Cum<0>=0. 


P0,Cum<*)>  !  SHOT  NOISE  eqs.  147-150 

flV.  NO.  PULSESxSEC  *  AVERAGE  PULSE  DURATION 
PARAMETER  OF  RAYLEIGH  AMPLITUDE  PDF 
PROBABILITY  OF  ZERO  AMPLITUDE  OF  SHOT  NOISE 
ARRAY  FOR  CUMULANTS 


Cum< 1 >=Overl ap*Si gmaa*. 25*PI*SQR< . 5*PI ) 
Cum<!2)=0Merl  ap-*S»4.  x3. 

FOR  K=3  TO  M 


Cum<K>=Cum<K-2)*S*K*Kx<K+l  > 

NEXT  K 

CALL  Momnt_vi  a_c  umnt(:M,Cum<-*>,  Mom<  *  )  ) 

Mom<0>=Mom<0)-P0  !  MOMENT  CORRECTION  FOR  IMPULSE  AT  ORIGIN 

SUBEND 
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PROGRAM  pHDMandRM 


10  ! 

CONTINUOUS  PART  OF  SHOT  NOISE  PDF, 

pc(u>}  COEFFICIENTS  OF  HERMITE 

20  ! 

EXPANSION  FOUND  DIRECTLY  VIA  MOMENTS  OR  RECURS 

IVELY  VIA  MOMENTS 

30 

M=30  !  MAXIMUM  ORDER  OF  APPRO 

XIMATION;  NUMBER  OF  MOMENTS  REQUIRED 

40 

DOUBLE  M, I , N, K  ! 

INTEGERS  < 

2''31  =  2,  147,483,648 

50 

REDIM  Mora 0 ;  M > ,  A < 0 ;  M >  ,  He < 0 ; M ) 

60 

REAL  Nom<0; 100 > , A < 0 : 1 00> , He< 0;  1 00> 

70 

CALL  Moment s < M , P0 , Mom <*> )  ! 

P0  IS  STEP 

AT  ORIGIN 

80 

Cent€r=Mom< 1 >.Mom<0)  ! 

CENTER  OF  PDF  pc<u> 

90 

R2=Mom  (  2  .'5  /  Mom  <  0  >  -  Cent  er^Cent  er  ! 

MEAN  SQUARE 

SPREAD  OF  pc(u:.' 

100 

Rms=SQR<R2)  • 

RMS  SPREAD 

OF  pc  <  u  > 

110 

A 1 pha8=Cent er  ! 

tmf  choices 

Alph3=Alpha0  AND 

120 

Beta0=Rms  ' 

Jet  a=Bet  a0 

WO'-Ljb  MAKE  A(  1  >=A<:2,'=0 

130 

A1 pha=Cent  er 

140 

Bet  a=Rms» 1 . 5 

150 

CALL  Coef  fhd_yi  a_mom<M,  AT ,  Beta, 

Mom(*) , A(*)  > 

!  DM 

160 

!  CALL  Coeffhr  Mia  momU'I.A  it,  it  a. 

Mom<  *> , R<*>  ) 

!  RM 

170 

PRINT  "Center  =  ";Center 

180 

PRINT  "Rrns  ='‘;Rms 

190 

Fl  =  l .  /(Bet  a*SQR<2.  »PI  > 

200 

INPUT  "ORDER  AND  LIMITS; ", N, U1 , U2 

210 

PRINT  "ORDER  AND  L I M I TS : " , N; U1 ; U2 

220 

Du=(U2-Ul>/100. 

230 

PLOTTER  IS  "GRAPHICS" 

240 

GRAPHICS  ON 

250 

WINDOW  U1,U2,0. , . 15 

260 

GRID  6. , . 03 

270 

FOR  1=0  TO  100 

280 

U=U1+Dm*I 

290 

T=<U-A1 pha>/Beta 

300 

CALL  Hermi  te(N,  f  ,  i;.: 

310 

Sum=A<0) 

320 

FOR  K=1  TO  N 

330 

Sum=Sum+A<  K ) *He  <  K ) 

340 

NEXT  K 

350 

P=F1*EXP<-. 5*T*T>*Sum 

!  PDF 

OF  RV  AT  U 

360 

PLOT  U,P 

370 

NEXT  1 

380 

PEHUP 

390 

GOTO  200 

400 

END 

410 

!  USE  ROUTINES  IN  PHDMS<RM 
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PROGRAM  PLRC 


10  !  STEP  PLUS  CONTINUOUS  PART  OF  SHOT  NOISE  CDF.  Pc<u);  TR  PC??,  FIGURE  20 
20  !  COEFFICIENTS  OF  GEN.  LAGUERRE  EXPANSION  FOUND  RECURSIVELY  VIA  CUMULANTS 
30  M=70  !  MAXIMUM  ORDER  OF  APPROXIMATION;  NUMBER  OF  CUMULANTS  REQUIRED 

40  DOUBLE  t1,I,N,K  !  INTEGERS  <  2'-31  =  2,147,483,648 

50  REDIM  Cum<:0;M),A<0:M>,L<0;M> 

60  REAL  CL4riii;0!  100>,Rc;0;  lOOi^Lte:  100>,P<0;  100) 

70  CALL  Cuniul  ant  s«:M,  P0,  Curii<*> )  !  P0  IS  STEP  AT  ORIGIN 

80  Center=CumC 1 >  !  CENTER  OF  PDF  pc<u> 

90  R2  =  Cum(:2;:'  !  MEAN  SQUARE  SPREAD  OF  pcu) 

100  RrrtS  =  SQR < R2 >  •  RMS  SPREAD  OF 

110  A1  pha0  =  Cent.er*C€nt.er^'R2-l .  !  THE  CHOICES  A 1  pha=A  1  phaO  AND 

120  Bet.a0=R2.'-Center  !  Bet.a=Beta0  WOULD  MAKE  A  <  1  )  =  A  ■:  2  >  =0 

130  Alpha=.74 

140  Beta=2.1 

150  CALL  Coef f 1 r_u i a_c um<M, A1 pha, Bet  a, Cum< *> , AC  * > >  !  RC 

160  PRINT  "Center  =  Center 

170  PRINT  "Rms  =";Rms 

180  Al=Alpha+l. 

190  01  =  1.-'A1 

200  F 1  =  1 . /FNGammaC A 1 ) 

210  INPUT  "ORDER  AND  LIMITS: ", N, U1 , U2 

220  PRINT  "ORDER  AND  L I M I TS : " , N; U 1 ; U2 
230  Du=<U2-Ul )/100. 

240  PLOTTER  IS  "GRAPHICS" 

250  GRAPHICS  ON 

260  WINDOW  U1,U2,-11. ,0. 

270  GRID  4. ,  1. 

280  P<0)=P0 

290  PLOT  0. ,LGT<P0> 

300  FOR  1=1  TO  100 

310  U=Ul+Du«I 

320  T=U''Beta 

330  CALL  Laguerre<N-l,Al,T,L(*>> 

340  Sum  =  AC0)«FNFl  <  A1 ,  T:)*01 

350  FOR  K=1  TO  N 

360  Sum  =  Sum  +  RCK::5*LCK-l  )/'K 

370  NEXT  K 

380  P<I>=p  =  ct+ri*EXPC-T+Rl*LOGCT>>*Suff.  !  PROBABILITY  THAT  RV  <  U 

390  IF  P>0.  THF.N  420 

400  PEHUP 

410  GOTO  430 

420  PLOT  U,LGTCP> 

430  NEXT  I 

440  PEHUP 

450  FOR  1=0  TO  100 

460  U  =  U1+Di.4*I 

470  P1=1.-PCI) 

480  IF  P1>0.  THEN  510 

490  PEHUP 

500  GOTO  520 

510  PLOT  U.LGTCPl) 

520  NEXT  I 

530  PENUP 

540  GOTO  210 

550  END 
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570 

580 

590 

600 

610 

620 

630 

640 

650 

660 

670 

630 

690 

700 

710 

720 

730 

740 

750 

760 

770 

780 

790 

800 

810 

820 

830 

840 

850 

860 

870 

880 

890 

900 

910 

920 

930 

940 

950 

960 

970 

980 

990 

1000 

1010 

1020 


PROGRAM  PLRC  (cont'd) 


DEF  FNGammaCX)  !  Gamma<X>  via  HART,  page  282,  #5243  eq.  2 

DOUBLE  H,K 

N=INT(X> 

R  =  X-N 

IF  H>0  OR  RO0.  THEN  640 

PRINT  "FHGatnma<X>  IS  NOT  DEFINED  FOR  X  =  "  j  X 
STOP 

IF  R>0.  THEN  670 
Gatnma2=  1 . 

GOTO  740 

P=439. 330444060025676+R*<50. 1086937529709530+R*6 . 74495072459252899 > 
P=8762. 7 10297852 14896+R*< 2008. 52740 1307279 12+R*P> 

P=42353. 6895097440896+R*<20886.86l7892698874+R»P) 

Q=499. 02852662 1439048-R*< 189. 498234 1570280 16-R*< 23. 08 155 1 524580 125-R>  > 
Q=9940. 30741508277090-R»( 1528. 60727377952202+R*Q> 

0=42353. 6895097440900  +  R'*  C2980.  38533092566499-R»Q ) 

Gainnia2=F'Q  !  Gamma<2+R)  for  R  <  1 

IF  N>2  THEN  780 

IF  H<2  THEN  830 

Gamina=Gamma2 

RETURN  Gamma 

Gamma=Gamma2 

FOR  K=1  TO  N-2 

Gamma=Gamma*  <  X-K  > 

NEXT  K 

RETURN  Gamma 
R=l. 

FOR  K=0  TO  1-N 
r=r*<X+K) 

NEXT  K 

Gamma=Gamma2/^R 
RETURN  Gamma 
FNEND 
! 

DEF  FNFl<fll,X>  !  1 F 1  < 1 ; fl 1  + 1 ; X )  eq.  C-2 

DOUBLE  K 
T=S=1 . 

FOR  K=1  TO  200 
T=T*X/<fil+K) 

S  =  S  +  T 

IF  T<=1.E-17*S  THEN  RETURN  S 
NEXT  K 

PRINT  "200  TERMS  IN  FNFl  flT"5fil;X 

RETURN  S 

FNEND 
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1030 
1040 
1050 
1060 
1070 
1080 
1090 
1100 
1110 
1120 
1130 
1140 
1260 
1270 
1280 
1290 
1420 
1430 
1440 
1450 
1460 
1470 
1480 
1490 
1500 
1510 
1520 
1530 
1540 
1550 
1560 
1570 
1580 
1590 
1600 
1610 
1620 
1630 
1 640 
1650 
1660 
1670 
1680 
1690 
1700 
1710 
1720 
1730 
1740 
1750 


PROGR/W  PLRC  (cont'd) 


SUB  Laguerre < DOUBLE  N,REflL  R 1 pha, X, L< * > >  !  eq.  96 

DOUBLE  K 
fll=fl) pha-1 . 

L<:0>  =  1. 

L<  1  >=fll pha+1 . -X 
FOR  K=2  TO  N 

L<K>  =  (:  <K  +  K+fll-X>*L<K-l  )-(K+Rl  )*L<K-2)  >.'K 
NEXT  K 
SUBEND 
! 

SUB  Momnt  Mia  cumnt < DOUBLE  M,REflL  Cum < * ) , Mom < * > > 

!  LISTED  IN^PHRC 
SUBEND 

t 

SUB  Cumnt._Mi  a_mor!  '-'t  (DOUBLE  M,REflL  Mom< * )  ,  Cum ( * )  ) 

!  LISTED  IN  PHRC 
SUBEND 
! 

SUB  Coeff  1  r__M  i  a_cum<  DOUBLE  M,REflL  fll  pha,  Bet  a,  Cum  ( •*  >  ,  R  C  *  >  > 

RLLOCRTE  B(0; M) , C<0; M) , D< 1 : M) 

DOUBLE  K,J,Jl,Mx 
T  =  Bet  a 

Cum< 1 )*Cum< 1 J/T 
FOR  K=2  TO  M 
T=T*Beta*<K-l ) 

Cum<K)=Cum<K)/T  !  NORMALIZED  CUMULRNTS;  eq.  62 

NEXT  K 
R 1  =fl  1  pha-t  1 . 

FOR  .J=l  TO  M 

J1=J+1 

T*!. 

S=fll 

FOR  K=1  TO  J 
T  =  T*<K-J1)-^K 
S=S+T*Cum(K) 

NEXT  K 
D< J)=S 
NEXT  J 

R<0>=B<0>=C<0>=EXP<Cum(0>) 

Q=i . 

FOR  K=1  TO  M 
S  =  0. 

FOR  J=1  TO  K 
S=S+D< J>#C<K-J> 

NEXT  J 
C<K>=C»S/K 
Q=Q*K/'<R1  pha+K> 

R(K>=C*Q 

B<K>=C*SQR<Q) 

NEXT  K 
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1760 
1  770 
17S0 
1790 
1800 
1310 
1820 
1838 
1340 
1858 
I860 
1870 
1880 
1890 
1900 
1910 
1920 
1930 
1940 
1950 
I960 
1970 
1980 
1990 
2000 
2010 
2020 
2030 
2040 
2050 
2060 
2070 
2080 
2090 
2100 
2110 
2120 
2130 
2140 
2150 
2160 
2310 


PROGRAM  PLRC  {cont'd) 


Mx=Mx+10 

IF  Mx<M  THEN  1760 
Thr  es-ho  1  d=-7 . 

T2=Threiho1 d*2. 

V=10.  -^Threshol  d 
GINIT 

PLOTTER  IS  "GRAPHICS" 

GRAPHICS  ON 

WINDOW  0. ,FLT<Mx),T2,0. 

LINE  TYPE  3 

FOR  J=0  TO  Mx  STEP  10 

MOVE  J,T2 

DRAW  J,0. 

NEXT  J 

FOR  J=T2  TO  0 
MOVE  0. , J 
DRAW  Mx,J 
NEXT  J 
PENUP 

LINE  TYPE  1 

IMAGE  4D,2<4X,M. 17DE> 

PRINT  "  K  B<K) 

Sum=0. 

FOR  K=0  TO  M 

b=b<;k) 

Sum=Sum+B*B 

PRINT  USING  1960;K,B,Sum 
IF  B<V  THEN  2060 
Y*LGT<B) 

GOTO  2100 
IF  B>-V  THEN  2090 
Y  =  T2-LGT<:-B) 

GOTO  210; 

Y=Thresho 1 d 
PLOT  K,Y 
NEXT  K 
PENUP 
SUBEND 

j 

SUB  Cumul  arits<DOUBLE  M,REAL  P0,Cum(»))  '  SHOT 

!  LISTED  IN  PHRC 
SUBEND 


Sum" 


NOISE 
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PROGWSM  pLRC 


10  ! 

CONTINUOUS  PART  OF  SHOT  NOISE 

PDF,  pcCu;' 

TR  7377,  FIGURE  21 

20  ! 

COEFFS.  OF  GENERAL.  LAGUERRE 

EXPANSION  FOUND  RECURSIVELY  VIA  CUMULANTS 

30 

M=70  !  MAXIMUM  ORDER  OF  APPROXIMATION;  HUMBER 

OF  CUMULANTS 

REQUIRED 

40 

DOUBLE  H,I,N,K 

!  INTEGERS  <  2- 

31  =  2,147,4S3 

,648 

50 

RED  I M  Cum ( 8 : M  > , A  <  0 ; M  > , L  <  0 ; M  > 

60 

REAL  Cum<0: 100) , A<0; 108) , LCO: 

100> 

70 

CALL  Cumu  1  ant  s.  ( M ,  P0 ,  Cum  (  *  )  > 

r  P0  IS  STEP  AT 

ORIGIN 

80 

Cent  er  =  Cum (  1  ) 

!  CENTER  OF  PDF 

p  C  u ) 

90 

R2=Cum  < 2  > 

!  MEAN  SQUARE  SPREAD  OF  pcOj) 

108 

R  m  5-  =  S  Q  R  <  R  2  ) 

!  RMS  SPREAD  OF 

pc  <  u ) 

110 

A 1  p.h.a0=Cent  er*Cent  er/'  R2- 1 . 

!  THE  CHOICES 

A 1  p  h  a = A 1  p  h  aO 

AND 

120 

Bet  a0=R2  ••  Cent  er 

!  Beta=Beta0 

WOULD  MAKE  A<1 

::'=A'::2  >=0 

130 

A1 pha=. 74 

140 

Beta=2. 1 

150 

CALL  Coef f 1 r_ui a_cum<M, A1 pha, 

Bet  a, Cum  <  *  > , A  <  *  > ) 

!  RC 

160 

PRINT  "Center  =  Center 

170 

PRINT  "Rms  =";Rms 

180 

F 1  =  1 . ^  < Bet a*FNGamma( A 1 pha+ 1 . > 

) 

190 

INPUT  "ORDER  AND  LIMITS; ",N 

,U1. 

200 

PRINT  "ORDER  AND  L  I  M I  ,  N ;  U 1 ; 

210 

Du=t:U2-Ur:'/100, 

220 

PLOTTER  IS  "GRAPHICS- 

230 

GRAPHICS  ON 

240 

WINDOW  U1 , U2, 0, , . 15 

250 

GR ID  6. ,.03 

260 

FOR  1=0  TO  100 

270 

U=Ul+Du*I 

280 

IF  U<0.  THEN  400 

290 

IF  U>0.  THEN  320 

300 

PLOT  0. ,0. 

3  1  0 

‘^OTO  400 

320 

T=U  'Beta 

330 

CALL  Laguerre(N, A1 pha, T, L '*) ) 

310 

Sum=A<0> 

3  50 

FOR  K=1  TO  N 

360 

Sum=Sum  +  A  )  *L  <  K  ) 

370 

NEXT  K 

380 

P  =  F1*EXP(;-T  +  RI  pha»LOG<T>  >*Sum 

!  PDF  OF  RV  AT 

1.1 

390 

PLOT  U,P 

400 

NEXT  I 

410 

PENUP 

420 

GOTO  190 

430 

END 

440 

!  USE  ROUTINES  IN  PLRC 
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PROGRAM  PLDMandRM 


STEP  PLUS  CONTINUOUS  PART  OF  SHOT  NOISE  CDF,  PcCu.-;  COEFFICIENTS  0 
GENERALIZED  LAGUERRE  EXPAN.  FOUND  DIRECTLY  AND  RECURSIVELY  VIA  nOMENT 


M=70  !  MAXIMUM  ORDER  OF  APPROXIMATION;  NUMBER 

DOUBLE  M,I,N,K  !  INTEGERS  <:  2  - 


nOMENTS  REOUIPED 


DOUBLE  M,I,N,K  !  INTEGERS  2-  31  =  2,14 

REDIM  Mom < O : M > , A < 0 ; M > , L  < 0 ; M > 

REAL  Home 0 : 1 00 > , A C 0 : 1 00 > , L ( 0 j 1 00 > . P < 0 ;  1  @0 ) 

CALL  riomentsciM.Pe.Mom';*))  !  P0  IS  STEP  AT  ORIGIN 

Cent- er'  =  Mom<  1 '<••••  Mom<0>  !  CENTER  OF  PDF  picOj.:' 

R2  =  MornC2).-Mom<0:)-Center*Center  !  MEAN  SQUARE  SPREAD  OF  pc  '  u  > 
Rms.=SQR<R2>  !  RMS  SPREAD  OF  pc<u;> 

A1  pha0  =  Center*Center^R2-l .  !  THE  CHOICES  A 1  phat=A  1  phaO 

Bet- a0  =  R2''Cent. er  !  Eet  a=Bet  a0  WOULD  MAKE  A'' 1 

At  pha=. 74 
Beta=2. 1 

CALL  Coef  f  1  d_v  1  a_mom<  M ,  til  pha,  Bet  a,  Mom  <  >  ,  A<  *  >  )  !  DM 

CALL  Coef  f  1  r_vi  a__moni<N,  A1  pha,  Bet  a,  Mom(;*>  ,  R<*>  >  !  RM 

PRINT  "Center  =  Center 
PRINT  "Rms  =";Rms 
Al=A1pha+l . 

01=1 . /A1 

F  1  =  1 .  ■■■'FHGammaC  A1  > 

INPUT  "ORDER  AND  LIMITS: ", N,U1 , U2 
PRINT  "ORDER  AND  L I M I TS ; " , N; U 1 ; U2 
Du=<U2-Ul  )  .'-100. 

PLOTTER  IS  "GRAPHICS" 

GRAPHICS  OH 
WINDOW  U1 , U2, -1 1 . , 0 
GRID  4. ,  1, 

P<0>=P0 

PLOT  0.  ,LGT(P0:) 

FOR  1=1  TO  100 
U=Ul+Du*I 
T=U -  Beta 

CALL  Laguerre  <  N- 1 , A 1 , T ,  L <  *  >  > 

Sum  =  AC0)'*’FNFl  <A1 ,  T)*01 
FOR  K=1  TO  N 
Sum  =  Sijm  +  R<K>»LCK-l  >/K 
NEXT  K 

P(:i>=p  =  P0  +  Fl*EXP(-T  +  Pl*LOG<:T))*Sum  !  PROBABILITY  THAT 

IF  P>0.  THEN  430 
PENUP 
GOTO  440 
PLOT  U,LGT(P) 

NEXT  I 
PENUP 

FOR  1=0  TO  100 
U=Ul+Du*I 
Pl  =  l  .  -Pf.I  > 

IF  P1>0.  THEN  520 
PENUP 
GOTO  530 
PLOT  IJ,LGT'::P1) 

NEXT  I 
PENUP 
GOTO  220 
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PROGRAM  PLOMandRC  (cont'd) 


580 

DEF  !  Gamffla<X) 

via  HfiRT,  page  282,  #5243 

590 

!  LISTED  IN  PLRC 

900 

FNEND 

910 

! 

920 

DEF  FNFl<fll,X) 

!  lFl<l;fil+i5X> 

930 

!  LISTED  IN  PLRC 

1020 

FNEND 

1030 

! 

1040 

SUE  LaguerreCDOUBLE  N.REflL 

fl 1 pha, X, L < * > >  !  Lnxalpha<X) 

1050 

!  LISTED  IN  PLRC 

1120 

SUBEND 

1130 

1 

1 140 

SUB  Morant  via  c umnt < DOUBLE 

MjRERL  CumC*>,Mom(»>) 

1  150 

!  LISTED  IN  PHRC 

1270 

SUBEND 

’1280 

1 

1290 

SUB  Coeffld  via  mom (DOUBLE 

M,REflL  R 1 pha, Bet  a, Mom ( * ) , fit  * > > 

1300 

fiLLOCRTE  B(0;M) 

1310 

DOUBLE  K,Kl,J,Mx 

1320 

T*1 . 

1330 

FOR  K=-l  TO  M 

1340 

T=T*(fl1pha+K)*Beta 

•  NORMRLIZED  MOMENTS  re 

1350 

Mom  ( K =Mom  <  K  >  T 

!  Alpha  and  Beta;  eq.  118 

1360 

NEXT  K 

1370 

Q=l. 

1380 

R(0)=BC0)=Mom(0) 

1390 

FOR  K=1  TO  M 

1400 

K1=K+1 

1410 

T=1 . 

1420 

S  =  Mom<  0 ) 

1430 

FOR  J=1  TO  K 

1440 

T  =  T*<.J-K1  >  .' J 

1450 

S=S+T*Mom( J) 

1460 

NEXT  J 

1470 

Q=Q*<fl1  piia+K)/K 

1480 

fl<K>=S 

1490 

B<K>=S*SQR(Q) 

1500 

NEXT  K 

1510 

Mx=l1x+ 1 0 

1520 

IF  Mx<M  THEN  1510 

1530 

Thre-shol  d  =  -7. 

1540 

T2=Threshold*2. 

1550 

V=10. '■Threshold 

1560 

GINIT 

1570 

PLOTTER  IS  “GRfiPHICS" 

1580 

GRfiPHICS  ON 

1590 

WINDOW  0. ,FLT<Mx), T2,0. 

1600 

LINE  TYPE  3 
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PROGRAM  PLDMandRM  (conf  d) 


1610 

FOR  .1  =  0  TO  Mx  STEP  10 

1620 

MOVE  J,T2 

1630 

DRftW  J,0. 

1640 

NEXT  J 

1650 

FOR  J=T2  TO  0 

1 660 

MOVE  0. , J 

1670 

DRftW  Mx,J 

1680 

NEXT  J 

1690 

PENUP 

1700 

LINE  TYPE  1 

1710 

IMAGE  4D,2<4X,M. 17DE) 

1720 

PRINT  "  K  B<K> 

Sum" 

1730 

Sum=0. 

1740 

FOR  K=0  TO  M 

1750 

B=B(K> 

1760 

Sum=Sum+B»B 

1770 

PRINT  USING  1710;K,B,Sum 

1780 

IF  B<V  THEN  1810 

1790 

Y=LGT<B> 

1800 

GOTO  1850 

1810 

IF  B>-V  then  1840 

1820 

Y=T2-LGT<-B) 

1830 

GOTO  1850 

1840 

Y=Thresho 1 d 

1850 

PLOT  K,Y 

1860 

NEXT  K 

1870 

PENUP 

1880 

fUBEND 

1890 

1 

1900 

SUB  Coefflr  a  rnom<DOUBLE  M.REftL  Alpha, Beta, 

MomC* ) , A<#) > 

1910 

ALLOCATE  B<0:M> 

1920 

DOUBLE  K,k:1,J,Mx 

1930 

T=1 . 

1940 

FOR  K=1  TO  M 

1950 

T=T*<Rlpha+K>*Beta  !  NORMALIZED 

MOMENTS  re 

1960 

Nom<K)=Mom<K)/-T  !  Alpha  and 

Bet  a;  eq.  11 

1970 

NEXT  K. 

1980 

Q=l. 

1990 

A<0)=B<0)=Mom<0) 

2000 

FOR  K=1  TO  M 

2010 

K1=K+1 

2020 

T=1 . 

2030 

S=Mom<K)-A<0) 

2040 

FOR  J=1  TO  K-1 

2050 

T=T*<J-Kl)xJ 

2060 

S=S-T*ft< J) 

2070 

NEXT  J 

2080 

IF  K  MOD  2=1  THEN  S=-S 

2090 

A<K)=S 

2100 

Q=Q#<Alpha+K)/K 

2110 

B<K>=S»SQR<Q> 

2120 

NEXT  K 
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PROGR^VI  PLDMandRM  (cont'd) 


2130 

f1x=Mx+10 

2140 

IF  Nx<M  THEN  2130 

2150 

Threshol d=-7 . 

2160 

T2=Thre5ho1d*2. 

2170 

V=  10.  ''Threshol  d 

2180 

GINIT 

2190 

PLOTTER  IS  "GRfiPHICS" 

2200 

GRfiPHICS  ON 

2210 

WINDOW  0. ,FLT<Mx),T2,0. 

2220 

LINE  TYPE  3 

2230 

FOR  J=0  TO  Mx  STEP  10 

2240 

MOVE  J,T2 

2250 

DRAW  J,0. 

2260 

NEXT  J 

2270 

FOR  J=T2  TO  0 

2280 

MOVE  0. , J 

2290 

DRAW  Mx,J 

2300 

NEXT  J 

2310 

PENUP 

2320 

LINE  TYPE  1 

2330 

IMAGE  4D,2<4X,M. 17DE) 

2340 

PRINT  "  K  B<K) 

2350 

Sum=0 . 

2360 

FOR  K=0  TO  M 

2370 

B=B<K) 

2380 

Sum=Sum+B»B 

2390 

PRINT  USING  2330;K,B,Sum 

2400 

IF  B<V  THEN  2430 

2410 

Y=LGT<B) 

2420 

GOTO  2470 

2430 

IF  B>-V  THEN  2460 

2440 

Y=T2-LGT<-B) 

2450 

GOTO  2470 

2460 

Y=Thresho 1 d 

2470 

PLOT  K,Y 

2480 

NEXT  K 

2490 

PENUP 

2500 

SUBEND 

2510 

! 

2520 

SUB  Moments<DOUBLE  M.REAL  P0,Mom<*)) 

!  SHOT 

2530 

!  LISTED  IN  PHDM&RM 

2670 

SUBEND 

Sum" 


NOISE 
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PROGRAM  pLDMandRM 

10  !  CONTINUOUS  PRRT  OF  SHOT  NOISE  PDF,  pc<ij)5  COEFFICIENTS  OF  GENERHL I  ZED 
20  !  LfiGUERRE  EXPANSION  FOUND  DIRECTLY  AND  RECURSIVELY  VIA  MOMENTS 
30  M=?0  !  MAXIMUM  ORDER  OF  APPROXIMATION;  NUMBER  OF  MOMENTS  REQUIRED 


40 

DOUBLE  M.I,N,K 

!  INTEGERS  <  2- 

31  =  2, 147, 

483, 

648 

50 

R  E  D I M  M  o  m  0 :  M  >  ,  A  <  0 ;  M  >  ,  L  <  0 :  M  ) 

60 

REAL  Mom  ( 0 :  1 00  ,  A  <  0 ;  1  @0  )  ,  L  ( 3 :  1 00  > 

70 

CALL  Mo M e  n t  £  ‘^  M ,  P 0 ,  M o tn 

!  P0  IS  STEP  AT 

ORIGIN 

80 

Cent er'=Mom ( 1  > -  MotnCO) 

!  CENTER  OF  PDF 

pc  <  u ) 

90 

R2=Mom  <  2  >  /  Mom  <0  '.>  -Cent  er  *  Cent  en 

!  MEAN  SQUARE  SPREAD  OF  pcCu) 

100 

Rm£=SQR<R2> 

!  RMS  SPREAD  OF 

pc  <  u  > 

110 

AT  pha0=Cent  er -^^Cent  er/R2-l . 

!  THE  CHOICES 

A1 pha=A1 pha0 

AND 

120 

Beta0=R2/Center 

!  Beta=Beta0 

WOULD  MAKE 

Ad  ) 

=A<2>=0 

130 

A1 pha=. 74 

140 

Bet  a=2.  1 

150 

CALL  Coeffid  o i a_mom < M , A 1 pha, Bet  a, Mom < * )  ,  A ( * > ) 

!  DM 

160 

!  CALL  Coefflr  oia  mom < M ,  A 1  pha,  Bet  a,  Mom< ♦ >  ,  A < » > > 

!  RM 

170 

PRINT  “Center  =  Center 

180 

PRINT  "Rms  =";Rm£ 

190 

F 1  =  1 . / <  Bet  a*FNGamma<  A 1 pha+ 1 .  >  > 

200 

INPUT  “ORDER  AND  LIMITS: “,N, 

U1,U2 

210 

PRINT  “ORDER  AND  L I M I T3 : “ , H; U 1 

;U2 

220 

Du=(;U2-Ul  >/100. 

230 

PLOTTER  IS  "GRAPHICS" 

240 

GRAPHICS  ON 

250 

WINDOW  U1 ,U2,0. , .  15 

260 

GRID  6. , . 03 

270 

PLOT  0. ,0, 

280 

FOR  1=1  TO  100 

290 

U=Ul+Du*I 

300 

T  sU/'Bet  a 

310 

CALL  Laguerre<N, A1 pha, T, L<*>  > 

320 

Sum=A(0> 

330 

FOR  K=1  TO  N 

340 

Sum  =  Sum  +  H  <  K  .)  ♦L  <  K ) 

350 

NEXT  K 

360 

P  =  F1*EXPC-T  +  R1 pha*L0G(T>  >*Sum 

!  PDF  OF  RV  AT 

U 

370 

PLOT  U,P 

380 

NEXT  I 

390 

PENUP 

400 

GOTO  200 

410 

END 

420 

!  USE  ROUTINES  IN  PLDMa:RM 
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Error  of  Zero-Crossing 
Location  for  Straight-Line 
Interpolation  of  Sampled 
Sinewave  in  Noise 


A.  H.  NuttaU 

ABSTRACT 

The  maximum  error,  rms  error,  and  the  average-magnitude  error  are 
evaluated  for  the  approximate  zero-crossing  location  obtained  by  using 
linearly-interpolated  values  of  a  sampled  sinewave.  If  the  sampling  rate 
is  greater  than  four  times  the  sinewave  frequency,  all  three  errors  are 
less  than  1.1  percent  of  the  period  of  the  sinewave.  In  the  presence  of 
additive  noise,  the  rms  error  is  derived  and  plotted  for  different  signal- 
to-noise  ratios  and  noise-bandwidth  to  signal-frequency  ratios. 
Limitations  on  the  approximate  analytic  result  are  pointed  out  and 
compared  with  simulation  results. 


Approved  for  public  release;  distribution  unlimited. 
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INTRODUCTION 

Sampling  of  a  bandlimited  waveform,  at  a  frequency  greater  than  twice  the 
highest  frequency  contained  in  the  waveform,  loses  no  information  according  to 
the  sampling  theorem.  However,  perfect  reconstruction  of  the  original 
waveform  from  the  samples  requires  that  two  conditions  be  met:  all  the  samples 
over  (-•,+*)  must  be  available,  and  sin(x)/x  interpolation  must  be  used.  The 
first  condition  can  never  be  met  exactly  and  the  second  is  often  too 
time-consuming  to  be  practical.  Furthermore,  determination  of  the  zero 
crossings  requires  solution  of  a  transcendental  equation,  which  is  very 
time-consuming.  Accordingly,  simpler  schemes  for  waveform  reconstruction, 
such  as  sample-and-hold  or  linear  interpolation,  are  often  employed. 

Here  we  investigate  the  error  incurred  by  using  linear  interpolation  of 
the  samples,  in  order  to  determine  the  zero-crossing  locations  of  the  original 
waveform.  In  particular,  we  first  consider  a  pure  sinewave  and  sample  it  at  a 
rate  greater  than  twice  the  sinewave  frequency.  The  error  in  zero-crossing 
locations,  afforded  by  linear  interpolation  between  adjacent  samples,  is 
evaluated  as  a  function  of  the  ratio  of  sampling  period  to  sinewave  period. 
When  noise  is  added,  the  error  depends  additionally  on  the  signal-to-noise 
ratio  and  the  noise  correlation.  Plots  of  the  maximum,  rms,  and  mean- 
magnitude  errors  are  given  in  the  noise-free  case,  whereas  the  rms  error  is 
presented  for  the  noise-present  cases. 
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NOISE-FREE  ZERO-CROSSING  ESTIMATION 

A  sinewave  of  amplitude  A  and  frequency  F  is  sampled  at  intervals  T 
seconds  apart.  The  sampling  is  not  synchronous  with  the  sinewave  frequency; 
thus  a  random  phase  is  associated  with  the  occurrence  of  sampling  relative  to 
the  sinewave.  The  situation  is  depicted  in  figure  1,  where  we  are  trying  to 
estimate  the  actual  zero-crossing  of  y{t)  at  t=(2F)“^;  we  must  have 
y(b)  <  0  <  y{a)  for  this  plot  to  be  relevant. 


Figure  1.  Estimated  Zero-Crossing  Location  z 

The  interval  between  the  samples  at  t=a  and  t=b  is 

T  »  b-a.  (1) 

Since  the  sampling  is  not  synchronized  with  the  sinewave,  the  sampling 
instant,  a,  is  uniformly  distributed  in  an  interval  such  that 

1  11 
a  £  b  =  T  +  a,  i.e.,  -  T  £  a  £ .  (2) 

The  zero-crossing  location,  z,  obtained  by  linearly-interpolating  between 
the  sample  values  at  a  and  b,  is 


b  y{a)  -  a  y(b)  b  sin(2irFa)  -  a  sin(2irFb) 


'X 
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where  the  sinewave  amplitude  cancels  out.  If  we  eliminate  b  via  use  of  (1), 
(3)  becomes 


z  *  a  +  T 


sin{2irFa) 


smuirta)  -  sin(ZirHa-i 


in  terms  of  sampling  interval  T. 


Instead  of  using  the  non-symmetric  interval  for  a  as  given  by  (2),  we  let 


1  T  4. 

a  -  2f  -  2  , 


where  now  c  is  uniformly  distributed  in  the  interval 

~  7  1  ^  £  7  • 

Physically,  c  is  the  displacement  of  the  midpoint  of  interval  (a,b)  from  the 
true  zero-crossing  at  {2F)”^.  Under  the  substitution  (5),  (4)  simplifies  to 


1  ^  -  T  tan(2TrFc) 

2  +  c  “  7  iFTT  • 


The  error  in  estimation  of  the  true  zero-crossing  location  is  then 


1  _  T  tan(2TtFc) 

e  -  z  =  c  -  Y  tanTifFT) " 


It  is  seen  from  (8)  that  the  error  e  is  odd  in  c.  Furthermore,  e  is  zero 
for  CaO  and  c=  *  T/2.  A  plot  of  error  e  in  (8),  normalized  relative  to  the 
sinewave  period,  is  given  in  figure  2  for  different  values  of  FT.  It  will  be 
observed  that  the  error  increases  significantly,  for  all  c,  as  FT  approaches 
.5-.  Also,  the  maximum  error,  e  =  .25/F,  occurs  for  FT  «  .5-,  which  corre¬ 
sponds  to  two  samples  per  period.  For  small  FT,  the  error  is  given  from  (8)  by 


for  FT  «  1 
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The  maximum  error  in  (9)  occurs  at  c  a  with  value 


2 

a  (FT)^  =*  .633  (FT)^  for  FT  «  1  .  (10) 

i/r  gY3* 

Thus  the  maximum  error  behaves  as  the  cube  of  FT  for  small  FT;  FT  is  the  ratio 
of  sampling  period  T  to  sinewave  period  1/F. 


Figure  2.  Error  e.  Relative  to  Sinewave  Period  1/F 

Since  c  is  a  random  variable  and  uniformly  distributed  over  *  T/2 
according  to  (6),  we  can  compute  rms  or  mean-magnitude  errors.  But  first 
observe  from  (8)  that  the  average  error,  e",  is  zero,  since  (8)  is  odd  in  c, 
which  is  itself  symmetrically  distributed  about  c»0. 
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We  are  interested  in  the  following  three  error  measures: 


e(max) 


e(rms) 


e(mag) 


max 


!cl<T/2 


T/2 

^  dc  e^  p(c) 
-T/2 


-il/2 


T/2 

J  dc  |el  p{c)  . 


-T/2 


(11) 


where  p(c)  is  the  uniform  probability  density  function  of  random  variable  c. 
These  are  respectively  the  maximum  error,  root-mean-square  error,  and 
mean-magnitude  error.  We  always  have 


e(mag)  <  e(rms)  _<  e(max);  (12) 

the  first  inequality  follows  from  use  of  Schwartz's  inequality  on  (11). 
Maximum  Error 


To  determine  the  location  of  the  maximum  of  the  error  e  in  (8),  we 
differentiate  with  respect  to  c  and  set  the  derivative  equal  to  zero,  getting 
location  c^  where 


cos  (2irFCQ) 


a 

tan(a) 


and  where 


a  E  irFT 


(13) 


(14) 


Then  the  location  is  explicitly 

Co  »  arc  tand/r-f) 


(15) 


where 
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Substitution  of  (15)  in  (8)  now  yields 

tan(V;:=I)  - ]  . 
As  FT-*0,  I — ►!+,  and  the  bracket  of  (17)  approaches 

2/^  n3/2  .  2  a^\ 

^r-l) 

the  last  step  via  use  of  (16).  Then  (17)  yields 


(17) 


(18) 


(19) 


(20) 


RMS  Error 

We  have  already  shown  that  e=0  by  use  of  (8)  and  (6).  The  mean-square 
value  of  e  is 


6 


TM  No.  831078 


This  integral  cannot  be  evaluated  in  closed  form,  due  to  the  cross-product 
term  in  the  integrand;  see  ref.  1,  eq.  2.646  1. 

For  small  FT,  we  have  a  «  1,  and  then 

tan(ox)  _  1  2„/,  „2x  i 

^  -  taS^  x{l-x  )  .  I 

leading  to 


e(rms)  „  ir^ 


3  V105 


(FT)^  =  .454  (FT)^  as  FT-^0. 


Just  as  for  e(max)  in  (19),  this  is  cubic  in  FT;  however,  the  scale  factor  is 
smaller  here,  as  anticipated  in  (12). 

As  FT-*. 5-,  ci-»ir/2-,  and  tan(a)-*+«>  in  (22);  then 


JL  =  .144  as  FT-.5- 
TTT-  ^ 


Mean-Magnitude  Error 

The  mean-magnitude  error  is,  from  (8)  and  (6), 

T/2  t  I 


=  7  I 


T  tan(2irFc] 
^  “7  tan  a) 


Alternatively,  using  (14)  and  ref.  1,  eq.  2.526  17, 


[cOS(a)) 

tan(a) 


We  are  able  to  eliminate  the  absolute  value,  by  reference  to  figure  2. 
For  small  FT,  a  «  1,  and  we  use  (23)  again  to  find 

2 

~  (PX)3  ,  ^411  (p-i-)3  . 
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The  scale  factor  is  smaller  than  in  (24),  in  keeping  with  (12). 

And  as  FT-*. 5-,  a-wif/2-,  tan(a)-*+«*,  giving  rise  to 

as  FT-..5-  .  (29) 

Plot  of  Three  Error  Measures 


A  plot  of  the  three  errors  (normalized  by  the  sinewave  period)  as  given 
by  (17),  (22),  and  (27),  is  given  in  figure  3.  The  errors  are  monotonically 
increasing  in  FT,  the  ratio  of  sampling  period  to  sinewave  period.  They  are 
all  cubic  in  FT  for  small  FT,  and  increase  rapidly  as  FT-^'.S-.  For  FT».25, 
the  errors  are  1.13^  .81%,  and  .731  of  the  sinewave  period;  thus  increasing 
the  sampling  frequency  to  double  the  minimum  required  for  the  sampling  theorem 
allows  for  linear  interpolation  with  an  error  in  zero-crossing  location  only 
about  Hof  the  sinewave  period. 
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FT,  lo  ctF  5c(mj>linj  "to  Smewove  |" 

pijure  3.  Tl^ret.  Error  Me^XurrS  -(i>r  Aloise-Frct  G? 
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ZERO-CROSSING  ESTIMATION  IN  ADDITIVE  NOISE 

The  observed  waveform  in  this  case  is 

y(t)  =  s(t)  ♦  n(t)  =.  A  sin(2irFt)  +  n{t),  (30) 

where  the  additive  independent  noise  n(t)  is  stationary  and  zero-mean.  The 
noise  need  not  be  Gaussian;  in  fact,  the  only  statistics  required  of  the  noise 
are  the  noise  power  and  correlation  coefficient  respectively: 

=  n^(t)  ,  p(x)  =  n(t)  n(tTTf  .  (31) 

0 

(Actually,  these  are  sufficient  only  for  the  high  signal-to-noise  ratio  case 
considered  below.) 

The  estimated  zero-crossing  is  still  given  by  the  first  equation  in  (3). 
When  (30)  is  substituted,  there  follows,  for  the  zero-crossing,  the  nonlinear 
functional 


z 


b)]  +  [b  n(a)  -  a  n(b)] 

b)T>  Cniai  -  nO))T  ' 


(32) 


The  signal  terms  are  Uj^,  U2.  while  the  noise  terms  are  v^,  ^2-  Since 
random  variables  v^  and  V2  can  take  on  any  value,  there  is  no  limit  on  the 
maximum  error,  as  there  was  in  the  noise-free  case.  And  since  the  rms  error 
is  intermediate  to  the  three  errors  considered  above  and  easier  to  evaluate 
than  the  mean-magnitude  error,  we  will  concentrate  solely  on  the  rms  error  in 
the  noise  case. 


We  begin  by  making  a  high  signal-to-noise  ratio  assumption;  that  is,  we 
assume 


signal  power 
noise  power 


s  R  » 


1 


(33) 


Then  (32)  becomes  approximately 
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The  Uj/u2  term  in  (34)  is  exactly  the  last  term  in  (3)  et  seq.;  the 
additional  two  terms  in  (34)  are  noise  terms  that  are  linearly  dependent  on 
the  noise  samples  n(a)  and  n(b),  under  the  high  signal-to-noise  ratio 
assumption.  If  we  did  not  make  this  assumption,  we  would  need  the  joint 
probability  density  function  of  the  noise  at  the  two  sample  instants  a  and  b. 

To  evaluate  the  mean  and  variance  of  z  in  (34),  we  will  temporarily  hold 
sample  times  a  and  b  fixed,  and  average  over  the  noise  statistics,  getting 
conditional  properties.  Then  we  will  employ  (1),  (5),  and  (6)  and  average 
over  random  variable  c  which  reflects  the  random  nature  of  the  sampling 
mechanism.  The  preliminary  average  over  the  noise  will  be  denoted  by  a  wavy 
overline;  thus  from  (34),  the  conditional  mean 


z 


—L  + 

Uo 


1  _ 

^2^  '  7,"^  ^2 


(35) 


since  noise  n(t)  has  zero-mean  for  all  t.  Then  appeal  to  (3)-(7)  gives 


z  =  ,  (36) 

2F 

just  as  in  the  noise-free  case;  this  conclusion  is  heavily  based  on  the  high 
signal-to-noise  ratio  assumption. 


We  now  consider  the  zero-mean  random  variable 
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w  s  z 


z  =  c 


T  tan(2irFc)  ^  ^ 
2  tan{o)  U2 


=  e 


* 


(37) 


which  is  the  perturbation  of  the  estimated  zero-crossing  location  from  the 
true  value  (2F)~^;  here  we  used  (34),  (36),  (7),  (8),  and  (14).  The 
conditional  mean-square  value  of  w  is 


since  Vj^  and  V2  have  zero-mean.  Now  from  (32), 

Vj^  =  b  n(a)  -  a  n(b),  =  n(a)  -  n(b)  .  (39) 

Therefore 

v^  =  a^(b^  +  a^  -  2abp)  =  2o^[(l-p)(c  * *  (1+p)^]  . 

'^l'^2  ~  ®^(^  -  bp  -  ap  +  a)  =  a^(l-p)(a+b)  =  2o^(l-p)^  ^  "Jf)  *  (^0) 

V^  =  0^(1  +  1  -  2p)  =  2a^(l  -  p)  , 

Where  we  used  (31),  (1),  (5),  and  defined 


p 


=  n(a)n(bT 


=  -i  n(a)n(a+T)  =  p(T) 


(41) 


Before  substituting  (40) 
and  U2.  From  (32),  (1),  (5), 


in  (38),  we  derive  simpler  expressions  for  u^ 
and  (30),  we  find 
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Uj^  =  2A  sin(a)  cos(2irFc)  -  AT  cos(o)  sin(2irFc), 

U2  ==  2A  sin(o)  cos(2nFc) 


(42) 


Then  expressing  (38)  as  the  sum  of  four  terms. 


(43) 


and  defining 


a  =  2irFc 


(44) 


I 

I 


we  have,  upon  use  of  (33), 


,  r  T  tan(a) 

=  1^-7  ifirW 


*2  “  ^  . , 


^3  -~W- 


__ — . — 

sin  (a)  cos  (a) 


^'2r)sin(o)  cos(a)  -  T  cos(a)  sin(a)J 


sin  (a)  cos  (a) 


T 


4 


l~p 

16R 


sin(a)  cos(8)  -  T  cos(a) 


sin^(o)  cos^(a) 


(45) 


We  now  have  to  average  the  sum  of  the  four  terms  in  (45)  over  the 
symmetric  distribution  for  c  given  in  (6).  However,  each  of  the  terms  T^, 

T^,  T4  have  even  and  odd  components  in  c,  and  the  odd  components  will 
average  to  zero.  When  we  retain  only  the  even  functions  of  c  in  (45)  and  then 
add  them  together,  a  number  of  terms  cancel,  after  considerable  manipulation, 
leading  to  the  significantly  simpler  expression 


even  {^2  +  T^ 


1  _  T^  (1-p)  cos^(a)  sin^(a)  (l'*'p)  s1n^(a)  cos^(a) 

16R  \  /•rtc>4/o\ 

sin  (o)  cos  (a) 


(46) 
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When  we  employ  (44)  in  (46)  and  average  over  c,  we  find,  upon  use  of  ref.  1, 
eqs.  2.526  30  and  2.526  10,  the  mean-square  error  of  the  zero-crossing 
location  (due  to  the  additive  noise)  as  the  surprisingly  brief  expression 


e^(noise)  1  1  2+p(T)  a 
Tp - -  ^  IT stHIT^ 


(47) 


upon  simplification  and  use  of  (41).  To  this  term  must  be  added  the  averaged 
Tj  term  in  (45),  which  is  simply  the  square  of  (22).  The  total  normalized 
rms  error  is  then 


1 


[dx  - 
0  ^ 


tan(ax)\^  ^  I 
tan(o)y  R 


^1/2 


2^-p(T)  g 
T  sin(2a) 


(48) 


Here  signal-to-noise  ratio  R  and  parameter  a  are  given  by 


R  =  ,  o  =  nFT  .  (49) 

a 

We  must  emphasize  that  (48)  is  only  valid  for  large  signal-to-noise  ratio, 

R  »  1,  so  that  approximation  (34)  is  valid. 


As  FT-*. 5-,  2a-*ii,  and  the  sin(2<»)  term  in  the  denominator  of  (48) 
approaches  zero.  This  appears  to  cause  the  rms  error  to  tend  to  +**  at 
FT  »  .5-.  However,  this  obvious  shortcoming  of  (48)  is  due  to  a  breakdown  of 
the  approximation  in  (34).  Specifically,  (34)  presumes  that  U2  is  not  zero 
and  that  it  is  large  compared  to  V2;  but  (32)  and  (42)  show  that  this 
quantity,  given  exactly  by 

U2  »  s(a)  -  s(b)  =  2A  sin(a)  cos(2iiFc)  =  2A  sin(irFT)  cos(2irFc)  ,  (50) 

can  be  small  for  some  values  of  c.  In  particular,  the  minimum  of  U2  is 

min  U2  =  2A  sin(TrFT)  cos(irFT)  »  A  sin(2irFT)  ,  (51) 
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which  tends  to  zero  as  FT-*.5.  Thus  the  occasional  values  of  c  near  *  T/2 
cause  U2  to  be  small  if  FT  is  near  .5,  and  the  approximation  in  (34)  to  be 
invalid.  Thus  (48)  is  invalid  as  FT-*.5,  regardless  of  the  signal-to-noise 
ratio. 


At  the  same  time,  we  observe  that  the  sin(iTFT)  term  in  (50)  reaches  a 
maximum  of  1  at  FT*. 5,  but  becomes  small  for  FT  near  zero.  Thus  approximation 
(34)  is  not  expected  to  be  valid,  nor  (48)  too  accurate,  for  small  FT.  In 
fact,  the  maximum  value  of  the  minimum  in  (51)  is  A,  at  FT*. 25.  Thus  (48)  is 
expected  to  be  most  accurate  in  the  neighborhood  of  FT*. 25.  Simulation 
results  bear  this  conclusion  out.  Furthermore,  FT  values  in  the  region  about 
.25,  like  (.15,  .35),  encompass  the  range  of  most  practical  interest  anyway; 
we  cannot  get  away  with  two  samples  per  cycle  and  we  don't  want  to  oversample 
if  we  don't  have  to. 


As  T-^0,  the  first  term  in  the  bracket  of  (48)  tends  to  zero;  see  (24). 
However,  the  second  term  does  not,  and  we  get 


(52) 


This  term  constitutes  a  lower  bound  on  the  zero-crossing  error,  even  as 
sampling  period  T  tends  to  zero.  (Notice  that  the  error  decays  inversely  with 
the  square  root  of  the  signal-to-noise  ratio  R.)  However,  the  precautionary 
note  in  the  above  paragraph  makes  (52)  suspect,  since  U2‘*0  then. 

Plot  of  RMS  Error 


In  order  to  plot  (48)  versus  FT,  we  must  have  a  functional  form  for  the 
noise  correlation  coefficient  p(T).  We  take  here  the  example  of  a  Gaussian 
correlation: 


p(r)  *  exp(-ir^W^)  .  (53) 

The  spectrum  corresponding  to  (53)  is  proportional  to 

exp(-f2/W^)  .  (54) 
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Thus  at  f  =  ±  W,  this  low-pass  spectrum  has  dropped  to  1/e  of  its  oeak  value 
at  f=0.  Other  correlations  and  spectra  are  possible,  including  bandpass  cases 
if  desired. 

Equation  (48)  requires  the  quantity 

oil)  =  exp{-AV)  =  exp(-aV/F^)  ,  (55) 

where  a  is  given  by  (49)  as  usual.  The  parameter  W/F  measures  the  ratio  of 
the  noise  bandwidth  (at  the  1/e  point)  to  the  signal  frequency  and  must  be 
specified  in  order  to  plot  (48)  vs  FT.  In  figures  4-6  are  plotted  the 
normalized  rms  error  (48)  for  W/F  =  .1,  1,  and  10  respectively,  for  various 
signal-to-noise  ratios. 

The  accuracy  of  the  analytic  results  in  figures  4-6  for  the  relatively 
low  signal-to-noise  ratio  of  R  =  10  =  10  dB  is  not  too  good,  because  (34)  is  a 
marginal  approximation  in  this  situation.  Simulation  results  in  the  next 
section  verify  that  (48)  is  a  good  approximation  for  R=20  dB  and  an  excellent 
approximation  for  R=30  dB,  provided  that  FT  is  not  near  0  or  .5. 

The  reason  for  the  lip  near  the  origin  in  figure  6  is  that  p(T)  in  (48) 
decreases  rapidly  when  the  signal  bandwidth  is  large.  The  eventual  rise  of 
the  a/sin(2o)  term  has  not  taken  effect  before  p(T)  has  essentially  decayed  to 
zero.  Physically,  noise  samples  that  are  highly  correlated  cause  more  of  a 
zero-crossing  perturbation  than  uncorrelated  noise  samples.  However,  the 
region  near  FT=0  in  figures  4-6  is  not  expected  to  be  reliable  because  the 
approximation  in  (34)  is  invalid. 
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SIMULATION  RESULTS 

A  program  for  simulation  of  exact  relation  (32)  is  given  in  the 
appendix.  A  result  for  the  noise-free  case  for  F=l,  T=.3,  and  100,000  trials 
in  given  in  table  1,  and  compared  with  the  analytical  results  in  (17),  (22), 
and  (27)  respectively.  The  agreement  is  excellent  for  all  three  error 
measures. 


_ Error _ Analytical _ Simulation _ 

Maximum  .020936  .020936 

RMS  .014978  .014995 

Mean-Magnitude  .013553  .013572 

Table  1.  Noise-Free  Comparison  for  F=l,  T=.3,  100,000  trials 

When  noise  is  added, .»a  simulation  result  for  F=l,  T=.3,  0=.4,  R=1000=30 
da,  and  100,000  trials  is  given  by  (set  aYT>em)'x) 

=  .015621  .  (56) 

The  correspond iijg  analytic  result  from  (48)  is  .015634. 

A  check  on  (52)  is  afforded  by  a  simulation  with  F=l,  T=.001,  p=l,  R=30  dB. 
The  contribution  of  the  first  term  in  (48)  is  .454  (.001)^  =  .454E-9,  as 
given  by  (24),  and  is  negligible  compared  with  the  second  term.  Whereas  (52) 
yields  .0035588,  the  simulation  yielded  .0035660,  which  is  excellent 
agreement,  considering  that  FT  <<  1  for  this  example.  The  saving  feature  here 
is  the  very  large  signal-to-noise  ratio  of  R=1000. 

Several  simulation  results,  at  100,000  trials  each,  are  displayed  as  Xs 
in  figure  6.  They  were  run  at  signal-to-noise  ratio  R  equal  to  10  dB,  20  dB, 
and  30  dB,  for  values  of  FT  equal  to  .05,  .1,  .25,  .4,  and  .45.  The  agreement 
between  analysis  and  simulation  is:  excellent  for  all  R^SO  dB  results;  very 
good  for  R=20  dB  except  when  FT  is  very  small  or  near  .5;  and  poor  for  R=10  dB 
except  when  FT  is  near  .25.  In  fact,  the  R=10  dB  results  for  FT=.05  and  .45 
were  off  the  graph,  and  those  for  FT=.l  and  .4  are  rather  inaccurate.  These 
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results  are  consistent  with  the  expectations  given  above  for  the  approximate 
analytical  result. 

Finally,  a  simulation  result  for  F=l,  T=.5,  W/F=.5,  R=30  dB,  and  100,000 
trials  gave  1.9488,  which  is  much  larger  than  any  of  the  ordinates  in  figures 
4-6.  There  is  no  check  on  this  result  since  (48)  is  not  valid  at  pt=.5.  The 
value  of  p  in  this  case  is,  from  (55),  exp(-(ir/2)^(l/2)^)  =  exp(-ir^/16)  =  .54. 
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SUMMARY 

In  the  noise-free  case,  the  maximum  error,  rms  error,  and  mean-magnitude 
error  have  been  derived,  and  the  normalized  error  has  been  plotted  (in  figure 
3)  as  a  function  of  FT,  the  ratio  of  sampling  period  T  to  sinewave  period 
1/F.  The  normalization  is  with  respect  to  the  sinewave  period. 

For  the  additive  noise  case,  the  rms  error  has  been  evaluated  and  plotted 
(in  figures  4-6)  for  a  variety  of  signal-to-noise  ratios  and  ratios  of  noise 
bandwidth  to  signal  frequency.  The  result  is  not  correct  for  small  signal-to- 
noise  ratio  or  as  FT'+O  or  .5-,  due  to  approximations  adopted  in  the  analysis, 
in  order  to  obtain  a  tractable  result.  Simulation  results  corroborate  the 
analysis  for  FT  values  not  near  0  or  .5,  and  for  large  signal-to-no-ise  ratio. 
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APPENDIX.  PROGRAM  FOR  SIMULATION 


10 

T=.  3 

SRMPLING  PERIOD;  T8KE  F=1 

20 

Rho=. 4 

1 

CORRELRTION  COEFFICIENT 

30 

R=1000 

SIGNRL-TO-NOISE  RRTIO 

40 

Tt.  =  100000 

1 

NUMBER  OF  TRIRLS 

50 

Th=. 5*flCS<Rho> 

€0 

Ct=COS<Th> 

70 

St=SIN<Th) 

80 

F  ac  =SQR  <  S'^'R ) 

90 

Tm=.5-T/2 

100 

Tp=.5+T/2 

110 

T2=2*P1 

120 

M1=H2=M3=M4=0 

130 

FOR  It=l  TO  Tt 

140 

C=<RND-. 5)»T 

150 

ft=Tm+C 

( 

SRMPLING 

160 

B=Tp+C 

1 

TIMES 

170 

GO  TO  240  INSERT 

THIS  LINE  FOR  NOISE-FREE  CRSE 

130 

X=<RND-.5)»Fac 

190 

Y=<RND-. 5>*Fac 

200 

Tc*Ct*X 

'10 

Ts=3t*Y 

220 

G*T.:+Ts 

1 

RDDITIVE  NOISE  WITH  DESIRED 

'  230 

H*Tc-Ts 

LEVEL  RND  CORRELRTION 

240 

Ya=SIN<T2*ft>+G 

250 

Yb-SIN<T2*B)+H 

260 

Z=  (,  B»Ya-fl*  Yb  >  ( Ya-Yb  > 

ZERO-CROSSING  ESTIMRTION 

^  270 

E=Z-.5 

ERROR 

280 

rii=m+E 

RVERRGE  ERROR 

1  290 

M2=M2+E*E 

SQURRED  ERROR 

1  300 

M3=n3+flBS<E) 

MRGNITUDE  ERROR 

310 

M4  =  MflX<M4,  fiBS'::E>  > 

MRXIMUM  ERROR 

320 

NEXT  It 

330  PRINT  T;ril/-Tt;SQR(H2/-Tt.  >;ri3.-  Tt;M4 
340  END 


3  -1 .  ir?51bl  1792E-0‘ 
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Mean  and  Variance  of 
Product  Array  Response: 
Application  to  a 
Cross-Line  Array 


A.  H.  Nuttall 

ABSTRACT 

The  mean  and  variance  of  the  product  of  the  narrowband  responses 
of  two  arrays  steered  to  the  same  look  direction  is  evaluated  and  shown 
to  depend  on  the  complex  coherence  between  the  two  array  outputs. 
For  a  cross-line  array  of  perpendicular  equi-spaced  elements,  the 
stability  is  much  poorer  than  for  a  sum  array  processor,  due  to  the 
largely  uncommon  volume  of  intersection  of  the  two  cones  of  response 
of  each  line.  When  each  array  is  extended  to  be  planar,  the  degradation 
in  stability  is  lessened,  tending  towards  the  sum  array  performance  as 
the  number  of  common  elements  increases. 
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INTRODUCTION 

A  planar  array  with  a  grid  structure  of  Mj  x  M2  elements  requires  a 
large  number  of  receivers  and  considerable  signal  processing  when  all  the 
elements  are  employed  and  actively  utilized.  In  an  effort  to  conserve  on  the 
number  of  elements  and  amount  of  signal  processing,  the  possibility  of  using  a 
sparse  array  seems  to  have  merit.  In  particular,  it  has  been  found  that  an 
equi-weighted  planar  array  has  the  same  auto  spectral  density  response  as  the 
cross  spectrum  of  a  pair  of  perpendicular  lines  of  double  the  length  and  with 
triangular  weighting  on  each  line.  However,  without  investigating  the 
variances  of  these  sum  and  cross-line  arrays,  respectively,  it  is  impossible 
to  decide  on  their  relative  merits. 

Here  we  will  consider  two  arbitrary  planar  arrays  (which  may  have  some 
common  elements  and  may  even  be  linear  arrays),  both  of  which  are  steered  to 
the  same  look  direction  and  employ  weightings  for  sidelobe  control.  The 
sample  cross-spectral  density  of  the  two  array  outputs  is  the  output  variable 
of  interest.  Thus  the  combination  of  arrays  is  resolving  in  both  spatial 
angles  (wavenumber)  as  well  as  in  temporal  frequency.  We  will  evaluate  the 
mean  and  variance  of  the  cross-spectral  density  estimate  at  the  system  output 
in  terms  of  the  statistical  properties  of  the  impingent  noise  field  and  the 
array  parameters,  such  as  look  direction  and  weighting. 

As  a  special  case,  by  choosing  the  two  planar  arrays  identical  in  element 
usage  and  weighting,  we  will  reduce  to  the  sum  array  since  the  cross-spectrum 
then  becomes  the  auto-spectrum.  Thus  we  can  compare  the  performances  of 
product  arrays  and  sum  arrays  in  terms  of  the  mean  and  variance  of  their 
responses. 
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CROSS-SPECTRAL  DENSITY  ESTIMATE 

Let  x(t)  and  y(t)  be  any  two  array  outputs  which  are  stationary  in  time, 

zero-mean,  and  have  auto-spectra  and  cross-spectrum  6„(f/,  6  (f),  G  (f), 

A  y  xy 

respectively,  f  is  temporal  frequency  in  Hz.  Sections  of  each  waveform  are 
gated  out  by  multiplying  by  temporal  weightings  and  then  subjected  to  Fourier 
analysis  according  to* 

Xjj,(f )  =  Jdt  exp{-i2irft)  Wjj,{t)  x{t)  for  1  £  m  £  N, 

Yf,{f)  =  J'dt  exp{-i2iTft)  w^{t)  y(t)  for  1  £  n  £  N.  (1) 

These  temporal  weightings  are  generally  taken  as  delayed  versions  of  a  basic 
weighting  w(t)  according  to 


w^(t)  =  w{t-nS),  (2) 

where  S  is  a  shift  or  time  delay;  however,  we  keep  the  more  general  case  in 
(1)  for  the  time  being. 

The  cross-spectral  density  estimate  at  frequency  f  is  obtained  by 
multiplying  outputs  (1)  and  averaging  in  time  according  to 

N 

n=l 


This  is  the  product  array  output;  it  has  resolution  capability  in  the  spatial 
angles  by  virtue  of  each  array  output  being  steered  to  the  same  desired  look 
direction,  and  it  has  frequency  resolution  governed  by  the  lengths  of  the 
weightings  in  (1)  or  (2). 

The  mean  of  a  general  product  term  of  components  of  (1)  is 


*An  integral  without  limits  is  over  the  entire  range  of  its  non-zero  integrand. 
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X^(f)'f*(f )  =  Jfdt  du  exp[-12.f(t-u)]  W|^{t)  w^{u)  R^y(t-u)  = 

-  J'<«-exp(-i2.fTr)  R,y(T)  i^{T)  =  . 

=  |du  G^y(u)§,^(f-u).  (4) 


where 


=  XU)  yU-'c)  (5) 

is  the  cross-correlation  of  array  outputs, 

is  the  aperiodic  correlation  of  and  w^» •  denotes  convolution,  and 

■  j"<irexp(-i2.fr)  t^(v)  =  W^(f)  W*(f)  (7) 

is  the  product  of  windows  of  the  individual  temporal  weightings. 

If  cross-spectrum  G  does  not  vary  significantly  in  the  width  of 

^jr 

window  (4)  yields  approximation 

Now  we  apply  these  results  to  find  the  mean  of  the  system  output  cross-spectral 
density  estimate  in  (3): 

N  N 

=  5  -  G,y(f)  2  4„„(0)  .  G,^(f)  2  h  («) 

n=!l  n=l 

which  is  proportional  to  the  true  cross-spectral  density  G  between  the  two 

xy 

array  outputs. 
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In  order  to  evaluate  the  variance  of  system  output  v  in  (3),  we  need 
magnitude-square  value  (suppressing  f) 

N 

m,n=l 

We  assume  that  the  filtered  outputs  and  in  (1)  are  complex  Gaussian 
(as,  for  example,  if  x(t)  and  y(t)  were  Gaussian).  We  then  observe  that 


Vn  =  exp[-i2itf(t+u)]  Wj^(t)  w^(u)  Rj^y(t-u)  = 

=  Jdv  Wj^(^-v)W^(^‘*’'>) •  (11) 

Now  for  f  removed  from  zero  by  at  least  the  reciprocal  of  the  segment  length, 
the  two  windows  in  (11)  do  not  overlap,  and  we  get 


X_  Y  a  0  for  f  ^  0  . 
m  n 


(12) 


Then  using  the  factoring  property  of  zero-mean  Gaussian  random  variables, 
(10)  becomes 


m 


if 

n  n 


ir 

x„ 

m  n 


m 


where  we  used  (12).  The  variance  of  random  variable  v  is 

N 


2  ^  |v-v|^  =  "WF  -  |vp  = 


K  Y„  = 
m  n  m  n 


m,n=l 


(13) 


N 

-  ^  [G,(f)*f„„(f)][G^(f )*§>)]  = 
m,n=l 

N 

a  G^(f)  G^(f)  ^  ij(0)  ,  (14) 

m,n=l 
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where  we  used  (9),  (4),  and  (8). 

We  now  specialize  the  general  weightings  in  (1)  to  the  particular  case  in 
(2),  obtaining  from  (6) 

^n,n(0)  =  Jdt  w(t-mS)  w(t-nS)  =  ^^^((n-m)S),  (15) 

where 

^„(r}  =  w(t)  w{t-T^  (16) 

is  the  aperiodic  correlation  of  basic  temporal  weighting  w.  Then  variance 

2 

Oy  in  (14)  becomes 

N  N-1 

m,n=l  p=l-N 

We  are  now  in  position  to  formulate  a  quality  ratio  for  the  output  of  the 
product  array.  Namely  we  define  the  complex  (voltage)  quality  ratio 


where  we  define  the  complex  coherence  between  the  array  outputs  as 


[G^(f)  Gy(f)] 


(19) 


and  have  employed  (9),  (17),  and  (15).  The  quantity  in  (18)  is  desired  large; 
it  has  leading  factor  fTT,  which  however  is  partially  compensated  by  the  last 
factor  of  (18)  if  shift  S  is  less  than  the  segment  length  of  temporal  weighting 
w.  A  detailed  investigation  of  the  temporal  processing  factors  in  (18)  is 
given  in  [1];  for  present  purposes,  the  factor  is  nearly  maximized  if  shift  S 
is  taken  about  50% of  the  segment  length. 


9 


TM  No.  841013 


However,  the  most  important  quantity  in  quality  ratio  (18)  is  the  complex 
coherence  at  frequency  f,  Yy„(f).  It  is  always  bounded  in  magnitude  by  1, 
and  can  be  significantly  less  than  1  if  the  two  array  outputs  x(t)  and  y(t) 
are  incoherent  at  frequency  f  of  interest. 

On  the  other  hand,  for  dentical  arrays  and  array  weightings,  we  have 

y(t)  =  x(t),  and  the  quality  ratio  is  again  given  by  (18),  where  y^Jf)  is 

xy ' 

replaced  by 


Yxx(f)  =  1-  (20) 

That  is,  the  sum  array  and  product  array  differ  in  their  complex  quality 
ratios  simply  by  the  factor  YYw(f),  which  is  the  complex  coherence  of  the 
two  arrays  in  the  product  formulation.  Thus  the  relative  performance  of  a 
product  array  can  be  investigated  by  determining  the  coherence  of  its  component 
array  outputs. 

With  this  information,  we  can  now  give  a  qualitative  measure  of 
performance  of  the  cross-line  array.  Consider  two  line  arrays  lying  along  the 
horizontal  and  vertical  axes,  respectively.  Suppose  both  lines  are  steered  to 
the  same  look  direction  in  three-dimensional  space.  Since  a  line  array  must 
inherently  have  maximum  response  everywhere  in  a  cone  of  symmetry  centered  on 
the  line,  the  two  cones  will  intersect  at  the  desired  look  direction,  but  will 
have  largely  non-overlapping  cones  at  other  angles.  Thus  only  a  small  fraction 
of  the  output  of  each  array  is  in  common;  in  fact,  most  of  each  array  output 
comes  from  uncommon  arrival  angles. 

Thus  the  two  line  array  outputs  will  be  largely  independent  of  each 
other,  meaning  low  coherence.  Furthermore,  the  longer  the  line  arrays,  the 
finer  becomes  the  angular  resolution,  and  the  common  intersection  volume  of 
the  cones  decreases.  Thus  the  performance  of  the  product  array  relative  to 
the  sum  array  becomes  poorer  as  the  line  arrays  become  longer.  In  the  next 
section,  these  conclusions  will  be  verified  by  a  detailed  quantitative 
analysis  of  the  coherence  between  two  general  array  outputs. 
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CROSS-SPECTRUM  OF  INDIVIDUAL  ARRAY  OUTPUTS 

Let  the  pressure  field  at  time  t  and  general  location  x,y  in  a  planar 
array  be  denoted  by  p{t,x,y).  Let  the  field  oe  stationary  and  homogeneous, 
with  temporal-spatial  correlation 


pTt^Tx^Ty^T^pTt^Tx^Ty^^  ~  ^p^^i~^2’^i~^2’'^i~'^2^  *  (21) 

The  frequency-wavenumber  spectrum  corresponding  to  Rp  is^p(f,u,v),  where 

Rp(T,u,v)  =  du  du  exp(i2irfr+iuu+iv\))  ,w.v)  .  (22) 

We  also  define  a  partial  transform  of  (22)  as 

J0fp(f.u,v)  =  JJdp  dv  exp(i  up+ivv)  ip(f  ,u,v)  .  (23) 

This  mixed  function  of  temporal  frequency  and  spatial  separations  will  be  of 
prime  importance  later,  especially  if  it  can  be  evaluated  in  closed  form. 


The  grid  structure  of  the  planar  array  is  such  that  the  elements  are 
equi-spaced,  being  located  at  positions  md,nd  in  the  x,y  plane,  for  m,n 
integer.  If  a  particular  element  is  absent  or  is  not  used  in  an  array  output, 
the  weighting  of  that  element  output  is  simply  set  equal  to  zero.  For  polar 
angle  i  as  measured  from  the  z-axis,  and  azimuthal  angle  o  as  measured  from 
the  x-axis,  the  time  delay  employed  at  location  md,nd,  in  order  to 
steer  in  desired  look  direction  ^  jis  [2,  Appendix  A] 

Tim  -  - 

where  d  is  the  element  spacing,  c  is  the  speed  of  propagation,  and 


o  =  sin(^  cos^ 


sine^ 


Broadside  to  the  planar  array  corresponds  to  <L  =  0. 


(25) 
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Array  output  x{t)  is  synthesized  by  choosing  a  particular  subset  of 

elements  in  the  planar  grid  structure,  weighting  their  outputs,  and  time-delay 

* 

steering  to  the  desired  look  direction  •  Thus 

•  ^26) 

By  simply  setting  some  weights  to  zero,  a  line  array  or  a  cross-line,  or  any 
desired  array  configuration,  can  be  realized.  Similarly,  a  second  array 
output,  which  may  employ  some  or  all  of  the  same  elements,  is 

y(t) 

mn 

The  cross-correlation  of  array  outputs  (26)  and  (27)  is,  upon  use  of  (21), 


Rj^y(T)  =  x(t)y(t-T)“  =  ^  w^(k,^)  Wy(m,n)  RpC^+T^-Tj^,(k-m)d,C(-n)d).  (28) 

Kimn 

Using  (23)  and  (24),  the  cross-spectrum  of  x  and  y  is 

Gxy(T)  =  ^  w^(k,J?)  w^(m,n)  exp[i2Trf(r^^-  (f,(k-m)d,C#.-n)d)  = 

k^mn 

=  ^  w^(k,Jl)  w^(m,n)  exp[i2Tff^(ak+B^ -am-en)]  Jrp(f , (k-m)d, C/-n)d)  = 

K£mn 

=  ^^j^y(d.f’)  exp[i2iTf^(aq+Br^  Ji'p(f,qd,rd)  ,  (29) 

qr 

where  we  let  q=k-m,  r=  -n,  and  defined 

^xy^^’*^)  =^w^(k,^)  Wy(k-q,^-r)  (30) 

kjf 


*A  summation  without  limits  is  over  the  entire  range  of  its  non-zero  summand. 


12 


TM  No.  841013 


as  the  two-dimensional  cross-correlation  of  the  weight  structure  employed  to 
yield  array  outputs  x(t)  and  y(t). 

As  the  first  special  case  of  the  above,  a  pair  of  perpendicular  cross- 
lines  can  be  realized  by  setting 

=  0  except  for  j2=  0, 

Wy(m,n)  =  0  except  for  m  =  0;  (31) 

in  this  case,  (30)  yields 


=  Wj^(q,0)  Wy(0,-r),  (32) 

and  (29)  becomes  the  cross-spectrum  of  the  cross-line  array. 


S^y^f)  exp[i2iif|-(aq+sr)]^(f,qd,rd).  (33) 

qr 

A  second  special  case  is  obtained  by  considering  the  sum  array,  which 
corresponds  to  setting 

w^(k,i)  =  Wy(k,J^)  =  w(k,i),  (34) 

thereby  getting  from  (30) 

^j^y(q,r)  =  ^  w(k,j5)  w(k-q,^-r)5  ^^(q.r)  ,  (35) 

kj? 

and  from  (29),  the  auto-spectrum  of  the  sum  array, 

exp[i2TTf^(aq+Br)]  Jfp(f,qd,rd)  .  (36) 

qr 

Comparison  of  special  cases  (33)  and  (36)  reveals  that  the  mean  responses 
of  the  cross-line  and  sum  arrays  can  be  made  equal  by  setting 
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Wj^(q,0)  Wy{0,-r)  =  ^^(q,r)  =2  «(!<»/()  w(k-q,i-r)  for  all  q,  r  .  (37) 

kJ? 

So,  for  example,  if  the  sum  weighting  w(k,^)  is  flat  over  a  rectangle, 

^5(q,r)  is  triangular  in  q  as  well  as  r,  over  a  rectangle  twice  the  size. 

Thus,  if  line  weightings  w^(q,0)  and  Wy(0,-r)  are  each  triangular  over 

this  double-length,  (37)  is  satisfied,  and  Gf^^(f)  =  Gf^^(f).  This  conclusion 

Ay  xy 

holds  irrespective  of  the  pressure  field  statistics  j2fp(f ,qd,rd) . 

Returning  now  to  the  general  case  of  (29)  and  (30),  the  auto-spectrum 
Gj^(f)  of  array  output  x(t)  in  (26)  is  easily  obtained  by  replacing  w^  by 
in  (30)  and  using  that  result  for  in  (29).  A  similar  procedure, 
but  now  replacing  w^  by  w^,  yields  the  auto-spectrum  Gy(f)  of  array 
output  y(t)  in  (27).  Combined  with  (29)  itself,  we  now  have  the  capability  of 
calculating  coherence  Yv,,(f)  as  given  earlier  by  (19). 

An  alternative  illuminating  form  for  cross-spectrum  G  (f)  is  obtained 

^y 

by  substituting,  for^  in  the  second  line  of  (29),  the  expression  (23)  and 
interchanging  surtmation  and  integration: 

Gxy(^)  =  dv  ^p(f,y,v)* 

*W^(27rf^+du,  2irf^+dv)  W*(27rf|«+du,  2wf^+dv)  ,  (38) 

where 

W^{a,b)  =  2  exp(ika+Ub), 

kje 

Wy(a,b)  =  ^  w^(m,n)  exp(ima+inb)  ,  (39) 

mn 

are  the  response  patterns  of  the  x  and  y  arrays.  Since  the  patterns  in  (39) 
peak  at  a  =  b  =  0,  the  integral  in  (38)  is  dominated  by  the  contribution  at 
spatial  frequencies 
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V 


2ti 

X 


sin^ 


cose^ 


9 


That  is,  the  cross-spectrum  in  (38)  is  influenced  mainly  by  frequency- 
wavenumber  spectrum  value  Jp(f,M,v)  at  the  values  given  by  (40).  x-c/f  is 
the  wavelength  at  the  frequency  f  of  interest. 
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EXAMPLES  OF  FREQUENCY-WAVENUMBER  SPECTRA 


luare  Sue 


Suppose  that  at  some  frequency  the  frequency-wavenumber  spectrum 

is  flat  over  a  square: 


$p(fo.u.v)  = 


?l(fo)  M  <  '^L*  M  <  •'l 

Aki 


0  otherwise 


where  is  the  comn,on  limit  of  wavenumbers  in  u  and  v.  Then  from  (23), 

.  ^  sin(k, u)  sin(k  v) 

-r;t= - •  ‘ 

This  closed-form  expression  is  separable  in  u  and  v  and  will  lead  to 
worthwhile  simplifications  when  employed  in  (29),  and  especially  cross-line 
result  (33). 


Circular  Support 


Suppose  instead  that 


ll(fo) 


fp{fo.i‘.v) 


0  otherwise 


Then  (23)  yields 


(f„) 


kju‘  *  v‘ 
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which  has  circular  symmetry  in  separation  space  u,v.  Although  in  closed  form, 
it  is  not  separable  in  u  and  v,  and  is  more  time-consuming  to  evaluate  than 
(42). 
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CROSS-LINE  ARRAY  WITH  SQUARE-SUPPORT  SPECTRUM 

In  this  section,  we  specialize  to  a  cross-line  array  as  depicted  in 
figure  1  and  couple  it  with  the  square-support  frequency-wavenumber  spectrum 


of  (41).  The  cross-line  array  has  one  element  at  the  origin  and  M  elements  in 
each  of  the  four  perpendicular  legs  protruding  from  the  origin,  for  a  total  of 
4M+1  elements.  All  elements  are  spaced  by  d  in  both  directions,  cons  stent 
with  (24)-(27). 

The  cross-spectrum  at  frequency  f^,  between  the  two  perpendicular 
lines,  is  given  by  (33)  with  (42): 


^xy^^^o^  ^w^(q,0)  Wy(0,-r)  expCik^d(aq+Br)] 

qr 


sin(k^dq)  sin(kj^dr) 
kj^dq  k^dr 
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and  the  weight  structure  on  each  line  has  been  assumed  real  and  symmetric 
about  the  origin.  The  quantities  in  (46)  are  all  real  and  require  only  two 
single-summations  of  size  M  at  each  value  of  the  three  dimensionless 
parameters  k^da,  k^de,  kj_d.  Here,  k^  is  the  common  limit  on  allowed 
wavenumbers  in  square-support  spectrum  (41),  and  k^  is  the  wavenumber 
corresponding  to  frequency  f^  of  interest.  Quantities  a  and  b  are  given  in 
terms  of  the  look  direction  according  to  (25). 

To  find  the  auto-spectrum  of  line-array  output  x(t),  we  replace  w^  by 
in  (30)  and  use  the  upper  line  of  (31): 

A 

k 

where 

'fx^{q)s2wx(k.O)  w^(k-q,0)  (48) 

k 

is  the  auto-correlation  of  the  x-array  weights.  Substitution  of  (47)  in  (29) 
yields 

exp(ikQdoq)jdp(fQ,qd,0)  = 

q 

2M  sin(k,dq) 

=  ^  5  'q  -  k-dq— •  <«> 

q=0 

where  we  used  (42)  and  (46).  In  a  similar  fashion,  the  auto-spectrum  of 
line-array  output  y(t)  is  given  by 

.  .  2M  sin(k,dr) 

fhf^)  =  ^  V  ^y(r)  cos(k„d8r)  ,  (50) 

r=0 


where 
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in  keeping  with  (31).  The  auto-spectral  results  in  (49)  and  (50)  each  require 

real  single-sums  of  size  2M.  No  double  summations  are  required  in  the  cross- 

spectral  result  of  (45)  or  in  the  auto-spectral  results  of  (49)  and  (50), 

although  in  the  latter  cases,  the  auto-correlations  “ijr  and  must  be 

XX  ryy 

fc) 

pre-computed.  The  complex  coherence  at  frequency  f  ,  y'  (f»).  between 

y  y 

individual  array  outputs  x(t)  and  y(t)  of  the  cross-line,  is  given  by  ratio 
(19)  as  usual;  the  factor  ^^(fQ) ,  as  well  as  the  absolute  scales  of  the 
weight  structures  (wj^(k,ojJ  ,  fwy(0,jl)},  will  cancel  out  in  the  ratio.  The 
fundamental  parameters  are  k^da,  k^de,  kj^d. 

For  broadside  steering  of  the  cross-line  array,  we  have  ^  =  0  aid  (25) 

yields  a  =  b  =  0.  Then  (45),  (49),  (50)  are  independent  of  k^,  and  the 

coherence  depends  only  on  kj^d. 
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CROSS-LINE  ARRAY  WITH  CIRCULAR-SUPPORT  SPECTRUM 

By  combining  (33)  with  the  circular-support  frequency-wavenumber  spectrum 
of  (44),  and  using  assumed  symmetry  of  the  line-array  weights,  we  obtain  cross 
spectrum 


(fo)  = 


M  M  2J,(k,  dV?^) 

5  «^qWx(q»0)cos(k^daq)  ^  E^Wy(0,r)cos(k^dBr) - - .  (52) 

q=0  r=0 


This  double  sum  can  no  longer  be  separated  into  the  product  of  two  single 
sums,  as  (45)  was,  due  to  the  coupling  caused  by  the  Bessel  function. 

However,  the  Bessel  function  need  only  be  computed  in  a  45“  sector  of  the  q,r 
plane  and  then  reflected  about  the  45°  line;  i.e.,  the  same  value  is  attained 
for  q,r  =  m,n  as  for  q,r  =  n,m. 


The  auto-spectrum  of  the  x-array  output  is  obtained  by  utilizing  (44)  in 
the  top  line  of  (49): 

^  21  ,  zj'idi.dd) 

G‘='(fo)  =  ^  c,  t«(«)  C05(k„da,)  ,  (53) 

q=0 

where  is  again  given  by  (48).  In  a  similiar  fashion,  there  follows 


^  2M 

)  =  2?!,  (f  )  "S  e 

y  '  0  ^1'  0  r 

r=0 

The  coherence  is  now  available  from  (52)-(54).  This  example  was  not  pursued 
numerically. 


2J,(k,  dr) 

fyyM  cosCk^dsr)  -  .  (54) 
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RESULTS 

A  program  for  the  calculation  of  the  coherence  of  a  cross-line  array,  via 
{45)-(51),  is  given  in  appendix  A.  It  was  exercised  to  give  the  following 
results  in  figures  2-6.  Although  these  plots  look  virtually  identical,  closer 
inspection  of  the  numerical  values  (not  included)  reveals  that  there  are  small 
(insignificant)  differences,  even  for  the  widely  different  values  of  k^d, 

^  considered  here.  The  degradation  of  the  cross-line  array  relative  to 
the  sum  array  is  virtually  independent  of  the  particular  look  angle  ^ • 
This  can  be  partially  explained  by  virtue  of  the  fact  that  at  broadside 
steering,  a  line  array  has  a  narrow  beam  but  covers  a  full  360"  angular  sweep, 
whereas  at  endfire,  the  beam  is  broad  but  exists  at  only  one  angle.  Thus  the 
total  angular  coverage  is  essentially  constant. 

The  overriding  impression  of  figures  2-6  is  that  the  degradation  of  the 
cross-line  array  is  significant,  relative  to  a  sum  array,  in  terms  of  the 
stability  of  the  cross-spectral  estimate.  This  is  particularly  so  as  the  size 
of  the  array  (4M+1  total  elements)  grows,  or  as  k|_d  increases  above  .5. 

Further  examples  of  interest  may  be  obtained  from  the  program  in  appendix  A. 
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SUMMARY 

When  the  horizontal  line  array  in  figure  1  is  time-delay  steered  to  look 
in  some  desired  direction  it  must  also  respond  in  a  cone  of  symmetry 

centered  on  the  axis  of  the  line.  Similarily,  although  the  vertical  line  is 
steered  to  look  in  the  same  direction  ^ »  it  too  has  a  cone  of  equal 
response,  but  now  centered  on  the  vertical  axis.  These  two  cones  will 
intersect  at  ^  and  thereby  lead  to  some  common  power  at  frequency  f  at 
their  respective  array  outputs,  prior  to  multiplication  and  averaging 
according  to  (3).  However,  both  arrays  also  respond  to  uncommon  (i.e. 
uncorrelated)  power  contributions  from  other  directions,  each  within  its  own 
cone  of  response.  The  sharper  the  beams  of  each  line  array,  the  less  common 
power  will  be  intercepted,  leading  to  less  coherence  between  the  two  line 
outputs.  Thus  the  stability  of  the  cross-line  array,  relative  to  the  sum 
array,  degrades  as  the  size  of  each  line  array  increases. 

If  each  of  the  product  arrays  were  made  of  a  parallel  pair  of  lines 
(separated  by  some  integer  multiple  of  d),  the  responses  of  each  would  be 
rather  complicated.  However,  there  would  again  be  some  common  overlap  at 
,  ^  ,  but  a  great  deal  of  uncommon  response  at  other  sidelobe  regions,  still 
causing  a  decreased  coherence  and  unstable  estimates.  As  more  parallel  lines 
are  added  to  each  product  array,  the  performance  should  monotonical ly  approach 
that  of  the  sum  array,  being  actually  realized  when  all  of  the  available 
parallel  lines  are  employed,  since  the  outputs  of  the  horizontal  and  vertical 
arrays  are  then  identical. 
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APPENDIX  A.  PROGRAM  FOR  CROSS-LINE  ARRAY 


The  following  program  calculates  the  coherence  of  a  cross-line  array  by 
means  of  (45)-(51).  M  is  the  number  of  elements  in  each  of  the  four 
perpendicular  legs  protruding  from  the  origin.  The  weighting  in  line  60  is 
assumed  the  same  for  both  lines  and  is  triangular.  The  autocorrelation  of  the 
weight  structure  is  computed  and  stored  in  line  130.  Inputs  of  k^d,  ^ 
are  required  in  lines  160-180  respectively.  When  these  latter  inputs  are 
desired  changed,  the  program  can  be  continued  at  line  160  instead  of  10, 
provided  that  the  array  weights  have  not  also  been  changed.  The  input  of 
k|^d  occurs  in  line  320.  The  dB  output  in  line  520  is  according  to 


dB  =  10  logi^Q 


^xy^^o^ 


» 


since  y 

xy 


is  proportional  to  the  voltage  quality  ratio. 
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